-- Logs begin at Tue 2022-08-30 00:09:52 UTC, end at Tue 2022-08-30 01:32:27 UTC. -- Aug 30 01:01:54.771635 dv-cinder-815712-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 01:01:54.780825 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 01:01:54.783485 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 01:01:54 2022] *** Aug 30 01:01:54.783485 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 01:01:54.783485 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 01:01:54.783485 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: nodename: dv-cinder-815712-11-iscsi Aug 30 01:01:54.783485 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: machine: x86_64 Aug 30 01:01:54.783485 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: clock source: unix Aug 30 01:01:54.783485 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: pcre jit disabled Aug 30 01:01:54.783485 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: detected number of CPU cores: 4 Aug 30 01:01:54.783485 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: current working directory: / Aug 30 01:01:54.783485 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: detected binary path: /usr/bin/uwsgi-core Aug 30 01:01:54.784081 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: your processes number limit is 47680 Aug 30 01:01:54.784081 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: your memory page size is 4096 bytes Aug 30 01:01:54.784081 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: detected max file descriptor number: 2048 Aug 30 01:01:54.784081 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: lock engine: pthread robust mutexes Aug 30 01:01:54.784081 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: thunder lock: enabled Aug 30 01:01:54.784081 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 01:01:54.784081 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 01:01:54.823671 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: Python main interpreter initialized at 0x55c00bd3f9c0 Aug 30 01:01:54.823671 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: python threads support enabled Aug 30 01:01:54.823671 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: your server socket listen backlog is limited to 100 connections Aug 30 01:01:54.823671 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: your mercy for graceful operations on workers is 90 seconds Aug 30 01:01:54.824059 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 01:01:54.824156 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: *** Operational MODE: preforking *** Aug 30 01:01:54.824348 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: *** uWSGI is running in multiple interpreter mode *** Aug 30 01:01:54.824348 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: spawned uWSGI master process (pid: 106208) Aug 30 01:01:54.824559 dv-cinder-815712-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 01:01:54.826111 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: spawned uWSGI worker 1 (pid: 106209, cores: 1) Aug 30 01:01:54.826111 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: spawned uWSGI worker 2 (pid: 106210, cores: 1) Aug 30 01:01:54.826111 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 01:01:55.493320 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 01:01:55.495412 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 01:01:56.594919 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:01:56.594919 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: from cryptography.utils import int_from_bytes Aug 30 01:01:56.595720 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:01:56.595720 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: from cryptography.utils import int_from_bytes Aug 30 01:01:56.596124 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:01:56.596124 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: from cryptography.utils import int_from_bytes Aug 30 01:01:56.596237 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:01:56.596237 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: from cryptography.utils import int_from_bytes Aug 30 01:01:59.111921 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:01:59.112496 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:01:59.112656 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:01:59.112793 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:01:59.113222 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:01:59.113314 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:01:59.113401 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:01:59.113561 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:01:59.113675 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.113947 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.114061 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:01:59.114195 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:01:59.114294 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.114562 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.114663 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.114884 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.114983 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.115188 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.115303 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.115503 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.115604 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.115816 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.115922 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.116119 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.116218 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.116376 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.116472 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.116685 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.116802 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.116999 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815712-11-iscsi {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.117100 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.117298 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.117396 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.117596 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.117693 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.117930 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.118031 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815712-11-iscsi {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.118244 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.118367 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.118539 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.118647 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.118851 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.118990 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.119146 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.119240 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.119457 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.119633 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.120187 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.120187 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.120421 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.120421 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.120624 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.120753 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.120871 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.120975 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.121155 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.121273 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.121467 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.121572 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.121830 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.122039 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.122126 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.122254 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.122433 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.122531 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.122753 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.122840 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.123094 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.123223 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815712-11-iscsi {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.123424 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.123583 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.123722 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.123938 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.124126 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815712-11-iscsi {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.124221 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.124440 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.124566 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.124750 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.124874 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.125066 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.125172 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.125482 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.125583 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.125821 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.125926 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.126125 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.126222 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.126451 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.126558 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.126761 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.126868 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.127066 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.127245 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.127378 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.127469 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.127672 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.127759 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.127975 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.128068 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.128277 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.128416 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.128590 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.128675 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.128891 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.128986 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.129190 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.129288 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.129435 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.129520 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.129758 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.129847 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.130086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.130187 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.130349 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.130461 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.130658 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.130755 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.130970 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.131069 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.131216 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.131319 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.131528 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.131733 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.131854 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.132055 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.132159 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.132253 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.132366 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.132591 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.132673 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.132750 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.132977 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.133064 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.133275 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.133366 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.134146 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.134273 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.134273 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.134427 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.134505 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.134582 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.134658 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.134748 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.134828 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.134915 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.135057 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.135144 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.135372 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.135474 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.135681 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.135772 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.136001 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.136087 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.136299 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.136397 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.136605 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.136712 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.136931 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.137031 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.137231 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.137317 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.137529 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.137620 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.137899 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.137997 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.138179 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.138267 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.139000 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.139102 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.139350 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.139495 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.139654 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.139807 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.139942 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.140074 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.140266 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.140349 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.140483 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.140614 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.140808 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.140932 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.141018 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.141272 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.141371 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.141576 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.141661 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.141850 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.141949 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.142164 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.142255 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.142442 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.142527 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.142754 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.142837 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.143053 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.143138 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.143350 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.143435 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.143645 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.143740 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.143941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.144025 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.144234 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.144325 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.144530 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.144615 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.144826 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.144911 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.145127 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.145257 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.145420 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.145525 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.145751 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.145841 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.146068 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.146152 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.146365 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.146474 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.146663 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.146747 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.146959 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.147058 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.147257 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.147350 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.147569 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.147653 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.147863 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.147947 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.148158 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.148264 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.148475 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.148576 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.148758 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.148849 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.149052 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.149150 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.149354 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.149448 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.149650 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.149758 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.149978 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.150108 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.150280 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.150375 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.150569 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.150660 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.150865 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.150963 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.151175 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.151265 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.151473 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.151557 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.151797 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.151904 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.152113 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.152204 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.152358 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.152453 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.152655 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.152751 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.152988 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.153086 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.153230 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.153315 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.153526 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.153612 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.153839 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.153928 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.155666 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.155778 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.155874 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.155955 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.156039 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.156117 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.156193 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.156276 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.156361 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.156445 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.156522 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.156598 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.156673 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.156775 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.156861 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.156939 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.157158 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.157253 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.157464 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.157558 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:01:59.157813 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.157913 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.158140 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.158232 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.158452 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.158545 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.158760 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.158854 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.159069 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.159163 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.159390 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.159491 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.159696 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.159789 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.160008 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.160110 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.160319 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.160409 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.160620 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.160714 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.160927 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.161011 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.161244 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.161337 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.161552 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.161658 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.161887 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.161986 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.162199 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.162285 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.162502 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.162586 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.162813 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.162910 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.163123 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.163208 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.163434 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.163518 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.163737 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.163829 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.164046 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.164131 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.164374 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.164459 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.164686 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.164770 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.164991 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.165083 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.165305 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.165450 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.165612 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.165707 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.165944 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.166031 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.166249 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.166333 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.166566 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.166659 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.166890 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.166975 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.167193 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.167284 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.167500 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.167592 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.167803 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.167893 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.168120 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.168206 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.168425 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.168518 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.168729 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.168873 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.169034 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.169120 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.169338 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.169424 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.169643 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.169801 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.170073 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.170174 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.170386 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.170513 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.170705 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.170840 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.171015 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.171159 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.171322 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.171521 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.171618 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.171814 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.171907 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.172137 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.172364 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.172450 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.172528 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.172752 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.172899 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.173067 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.173161 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.173363 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.173446 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.173665 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.173780 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.173993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.174080 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.174297 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.174388 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.174603 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.174688 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.174901 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.174986 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.175205 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.175307 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.175510 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.175595 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.175809 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.175893 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.176114 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.176199 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.176420 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.176506 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.176723 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.176817 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.177027 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.177112 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.177331 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.177423 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.177631 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.177716 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.177975 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.178060 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.178279 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.178374 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.178576 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.178660 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.178883 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.178967 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.179181 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.179272 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.179483 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.179567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.179799 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.179882 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.180102 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.180198 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.180407 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.180490 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.180712 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.180858 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.181007 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.181143 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.181319 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.181456 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.181627 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.181774 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.181954 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.182094 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.182264 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.182397 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.182577 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.182706 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.182875 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.183032 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.183192 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.183322 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.183508 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.183650 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.183818 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.183948 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.184118 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.184248 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.184420 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.184557 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.184718 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.184848 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.185017 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.185158 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.185316 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.185518 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.185777 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.185868 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.186088 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.186241 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.186390 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.186486 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.186689 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.186782 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.186988 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.187081 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.187289 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.187382 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.187608 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.187691 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.187909 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.187999 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.188209 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.188302 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.188505 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.188596 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.188801 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.188885 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.189153 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.189302 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.189446 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.189581 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.189801 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.189957 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.190105 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.190245 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.190628 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.190781 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.190952 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.191083 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.191263 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.191405 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.191574 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.191704 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.191878 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.192014 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.192183 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.192326 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.192488 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.192619 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.192792 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.192934 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.193104 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.193233 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.193407 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.193536 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.193718 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.193918 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.194028 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.194096 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.194349 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.194444 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.194653 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.194751 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.194960 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.195052 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.195257 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.195341 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.195566 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.195652 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.195886 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.195978 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.196198 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.196283 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.196514 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.196653 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.196817 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.196936 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.197117 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.197201 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.197430 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.197554 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.197752 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.197854 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.198063 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.198164 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.198366 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.198464 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.198669 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.198766 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.198981 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.199095 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.199285 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.199384 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.199594 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.199727 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.199899 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.200051 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.200203 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.200332 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.200503 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.200638 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.200812 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.200952 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.201634 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.201738 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.201968 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.202107 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.202293 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.202472 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.202623 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.202787 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.202927 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.203123 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.203238 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.203433 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.203565 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.203698 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.203832 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.204024 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.204163 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.204357 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.204504 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.204667 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.204804 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.204978 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.205128 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.205281 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.205410 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.205589 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.205749 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.205920 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.206091 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.206224 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.206310 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.206522 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.206618 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.206823 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.206934 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.207124 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.207218 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.207422 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.207507 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.207719 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.207806 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.208023 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.208108 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.208328 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.208413 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.208630 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.208715 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.208947 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.209033 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.209263 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.209347 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.209562 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.209647 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.209897 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.209986 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.210211 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.210294 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.210516 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.210603 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.210816 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.210946 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.211115 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.211199 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.211412 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.211497 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.211724 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.211807 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.212037 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.212127 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.212336 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.212420 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.212650 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.212780 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.212944 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.213036 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.213244 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.213327 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.213553 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.213637 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.213880 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.213981 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.214187 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.214271 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.214501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.214586 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.214808 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.214901 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.215110 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.215194 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.215415 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.215499 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.215720 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.215806 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.216023 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.216165 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.216325 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.216456 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.216698 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.217313 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.217571 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.217705 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.217913 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.218032 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.218218 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.218340 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.218518 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.218655 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.218823 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.218968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.219135 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.219291 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.219604 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.219719 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.219918 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.220048 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.220231 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.220358 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.220537 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.220672 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.220848 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.220987 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.221166 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.221337 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.221663 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.221829 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.222012 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.222099 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.222321 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.222408 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.222623 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.222707 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.222926 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.223014 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.223228 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.223339 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.223528 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.223673 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.223833 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.224002 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.224177 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.224317 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.224432 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.224625 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.224731 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.224936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.225021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.225247 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.225347 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.225554 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.225639 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.225890 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.225990 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.226193 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.226278 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.226500 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.226592 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.226799 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.226891 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.227100 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.227186 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.227398 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.227527 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.227710 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.227805 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.228010 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.228095 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.228306 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.228392 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.228604 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.228701 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.228900 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.228985 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.229208 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.229292 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.229513 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.229643 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.229859 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.229946 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.230170 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.230255 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.230474 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.230563 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.230778 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.230865 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.231078 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.231206 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.231395 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.231482 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.231692 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.231777 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.231990 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.232075 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.232342 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.232437 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.232653 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.232772 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.232957 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.233054 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.233255 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.233340 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.233559 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.233644 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.233886 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.233988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.234191 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.234275 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.234489 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.234572 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.234784 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.234876 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.235088 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.235172 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.235386 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.235474 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.235693 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.235787 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.235993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.236083 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.236289 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.236376 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.236585 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.236678 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.236885 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.236969 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.237184 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.237276 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.237481 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.237566 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.237806 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.237896 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.238104 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.238190 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.238407 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.238493 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.238701 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.238784 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.238998 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.239083 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.239295 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.239388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.239595 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.239678 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.239902 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.239995 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.240199 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.240282 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.240513 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.240595 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.240811 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.240902 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.241105 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.241188 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.241402 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.241485 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.241705 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.241849 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.242026 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.242117 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.242321 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.242414 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.242622 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.242715 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.242933 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.243064 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.243236 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.243323 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.243529 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.243614 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.243832 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.243915 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.244126 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.244209 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.244422 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.244507 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.244719 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.244810 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.245018 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.245101 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.245313 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.245398 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.245608 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.245692 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.245931 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.246017 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.246228 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.246321 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.246523 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.246608 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.246823 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.246918 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.247125 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.247209 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.247421 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.247504 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.247718 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.247812 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.248041 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.248150 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.248376 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.248621 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.248715 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.248803 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.249008 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.249094 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.249306 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.249399 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.249611 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.249705 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.249953 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.250043 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.250253 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.250337 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.250553 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.250650 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.250858 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.250949 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.251153 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.251250 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.251460 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.251549 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.251761 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.251846 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.252063 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.252155 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.252360 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.252446 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.252656 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.252747 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.252970 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.253054 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.253272 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.253358 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.253575 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.253659 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.253904 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.253994 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.254217 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.254304 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.254529 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.254628 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.254819 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.254917 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.255121 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.255205 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.255424 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.255508 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.255726 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.255818 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.256037 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.256146 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.256334 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.256420 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.256647 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.256811 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.256966 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.257110 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.257286 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.257418 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.257531 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.257627 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.257859 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.257965 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.258161 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.258248 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.258465 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.258553 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.258770 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.258855 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.259069 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.259153 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.259375 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.259459 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.259679 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.259762 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.259977 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.260069 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.260279 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.260364 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.260580 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.260701 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.260877 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.260963 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.261174 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.261268 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.261499 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.261656 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.261824 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.261955 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.262122 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.262229 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.262429 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.262526 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.262733 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.262827 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.263043 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.263129 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.263347 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.263432 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.264203 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.264341 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.264477 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.264595 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.264888 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.264972 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.265194 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.265291 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.265494 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.265578 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.265821 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.265910 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.266122 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.266210 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.266420 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.266505 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.266720 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.266803 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.267033 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.267126 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.267331 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.267415 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.267628 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.267712 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.267925 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.268010 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.268239 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.268324 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.268537 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.268621 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.268851 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.268943 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.269185 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.269270 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.269490 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.269583 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.269816 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.269906 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.270122 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.270282 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.270441 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.270595 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.270731 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.270865 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.271049 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.271189 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.271464 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.271619 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.271780 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.271865 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.272081 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.272165 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.272389 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.272483 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.272693 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.272786 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.273009 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.273094 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.273327 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.273420 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.273629 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.273722 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.273964 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.274052 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.274264 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.274349 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.274582 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.274670 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.274898 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.274983 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.275205 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.275297 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.275520 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.275608 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.275826 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.275931 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.276144 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.276249 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.276452 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.276538 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.276776 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.276920 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.277097 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.277229 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.277413 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.277551 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.277749 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.277883 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.278057 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.278206 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.278342 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.278476 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.278641 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.278773 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.278958 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.279186 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.279320 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.279558 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.279689 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.279912 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.280052 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.280218 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.280351 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.280487 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.280621 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.280774 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.280910 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.281087 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.281224 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.281386 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.281517 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.281704 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.281876 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.282033 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.282120 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.282350 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.282436 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.282660 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.282752 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.282958 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.283091 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.283261 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.283391 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.283564 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.283658 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.283862 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.283997 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.284142 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.284324 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.284472 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.284613 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.284786 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.284927 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.285068 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.285199 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.285385 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.285517 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.285709 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.285885 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.286055 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.286210 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.286354 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.286489 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.286633 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.286764 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.286933 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.287071 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.287277 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.287408 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.287584 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.287714 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.287900 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.288032 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.288187 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.288319 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.288486 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.288636 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.288792 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.288930 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.289092 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.289225 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.289393 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.289523 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.289697 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.289868 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.290025 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.290112 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.290326 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.290460 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.290625 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.290769 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.290923 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.291053 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.291243 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.291381 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.291544 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.291683 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.291863 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.291964 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.292164 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.292249 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.292462 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.292554 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.292762 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.292853 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.293059 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.293144 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.293359 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.293451 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.293684 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.293809 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.294017 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.294109 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.294319 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.294405 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.294634 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.294775 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.295033 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.295121 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.295344 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.295544 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.295637 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.295876 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.295968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.296191 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.296278 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.296506 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.296690 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.296835 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.296976 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.297119 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.297258 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.297390 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.297532 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.297701 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.297851 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.298038 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.298134 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.298353 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.298476 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.298711 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.298894 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.299027 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.299217 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.299340 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.299527 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.299648 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.299843 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.299958 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.300154 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.300258 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.300464 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.300619 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.300766 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.301064 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.301198 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.301370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.301504 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.301675 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.301842 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.302026 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.302164 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.302345 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.302478 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.302659 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.302805 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.302968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.303108 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.303279 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.303413 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.303590 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.303680 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.303897 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.303982 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.304203 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.304287 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.304509 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.304594 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.304839 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.304925 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.305172 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.305379 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.305464 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.305542 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.305788 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.305880 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.306076 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.306175 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.306384 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.306521 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.306689 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.306776 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.306994 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.307130 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.307300 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.307430 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.307607 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.307741 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.307910 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.308046 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.308213 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.308355 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.308517 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.308646 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.308823 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.308962 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.309132 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.309267 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.309445 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.309588 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.309788 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.309928 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.310097 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.310237 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.310964 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.311146 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.311278 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.311419 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.311585 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.311910 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.312044 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.312253 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.312399 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.312572 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.312707 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.312888 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.313116 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.313247 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.313382 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.313521 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.313653 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.313854 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.314029 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.314181 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.314344 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.314474 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.314679 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.314821 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.315004 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.315140 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.315329 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.315712 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.315897 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.316030 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.316214 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.316348 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.316519 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.316675 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.316820 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.316916 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.317129 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.317224 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.317431 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.317523 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.317752 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.317983 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.318071 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.318331 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.318416 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.318647 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.318736 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.318972 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.319065 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.319288 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.319372 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.319604 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.319700 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.319912 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.320130 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.320257 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.320518 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.320614 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.320805 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.320911 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.321133 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.321219 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.321595 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.321756 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.321756 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.321979 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.322084 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.322171 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.322355 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.322441 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.322661 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.322756 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.322960 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.323046 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.323267 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.323362 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.323565 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.323695 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.323885 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.323984 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.324187 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.324280 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.324484 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.324569 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.324786 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.324872 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.325094 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.325225 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.325390 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.325481 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.325688 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.325802 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.326058 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.326671 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.326901 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.327101 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.327368 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.327501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.327635 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.327795 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.327880 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.327959 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.328089 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.328256 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.328396 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.328619 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.328719 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.328866 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.328993 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.329172 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.329307 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.329519 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.329604 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.329862 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.329952 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.330170 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.330264 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.330469 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.330553 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.330779 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.330864 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.331084 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.331225 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.331403 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.331489 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.331709 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.331801 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.332012 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.332097 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.332335 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.332426 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.332649 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.332734 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.332958 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.333169 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.333281 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.333497 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.333582 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.333835 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.333990 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.334161 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.334338 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.334575 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.334675 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.334786 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.335085 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.335215 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.335383 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.335469 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.335700 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.335794 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.336007 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.336092 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.336311 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.336397 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.336617 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.336715 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.336922 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.337008 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.337225 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.337309 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.337528 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.337623 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.337866 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.337956 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.338171 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.338268 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.338474 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.338561 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.338776 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.338862 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.339077 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.339163 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.339378 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.339465 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.339681 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.339767 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.339988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.340072 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.340292 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.340385 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.340597 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.340690 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.340906 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.341000 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.341214 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.341300 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.341519 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.341662 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.341890 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.342034 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.342186 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.342271 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.342491 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.342795 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.342957 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.343100 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.343186 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.343408 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.343493 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.343723 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.343869 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.344027 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.344112 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.344325 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.344410 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.344632 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.344739 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.344941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.345047 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.345253 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.345359 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.345580 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.345667 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.345919 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.346024 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.346224 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.346319 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.346592 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.346685 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.346909 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.347010 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.347253 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.347408 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.347500 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.347586 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.347810 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.347896 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.348142 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.348251 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.348465 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.348558 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.348838 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.348937 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.349072 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.349165 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.349372 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.349458 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.349671 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.349782 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.350006 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.350094 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.350319 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.350403 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.350623 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.350707 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.350922 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.351008 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.351217 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.351309 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.351518 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.351603 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.351814 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.351899 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.352110 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.352196 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.352406 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.352504 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.352703 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.352788 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.353003 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.353088 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.353298 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.353396 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.353593 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.353680 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.353916 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.354014 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.354213 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.354310 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.354508 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.354600 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.354803 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.354889 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.355103 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.355198 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.355396 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.355499 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.355693 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.355785 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.355988 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.356080 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.356283 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.356368 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.356577 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.356661 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.356879 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.356964 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.357181 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.357302 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.357561 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.357644 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.357909 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.358010 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.358208 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.358293 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.358512 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.358610 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.358811 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.358903 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.359127 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.359278 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.359440 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.359581 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.359749 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.359882 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.360057 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.360188 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.360378 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.360517 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.360679 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.360809 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.360982 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.361124 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.361267 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.361406 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.361575 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.361707 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.361895 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.362069 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.362208 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.362352 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.362486 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.362620 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.362802 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.362937 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.363087 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.363219 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.363403 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.363540 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.363713 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.363842 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.364003 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.364133 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.364319 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.364451 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.364623 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.364753 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.364930 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.365060 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.365223 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.365310 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.365518 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.365671 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.365843 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.365932 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.366149 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.366451 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.366524 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.366758 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.366995 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.367440 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.367754 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.368032 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.368164 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.368357 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.368491 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.368666 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.368824 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.368963 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.369116 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.369280 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.369408 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.369591 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.369753 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.369924 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.370068 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.370239 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.370376 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.370552 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.370690 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.370879 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.371017 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.371192 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.371330 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.371498 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.371627 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.371834 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.371966 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.372129 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.372258 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.372435 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.372572 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.372734 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.373397 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.373533 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:01:59.373622 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.374009 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.374282 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.374594 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.374899 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:01:59.375144 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:01:59.526657 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO dbcounter [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] Registered counter for database nova_api Aug 30 01:01:59.529105 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO dbcounter [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] Registered counter for database nova_api Aug 30 01:01:59.548153 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_db.sqlalchemy.engines [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:01:59.551716 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG oslo_db.sqlalchemy.engines [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:01:59.554935 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writer thread running {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:01:59.558262 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writer thread running {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:01:59.611876 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.context [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4036817-1eea-418e-8a05-ed30a823773a(cell1) {{(pid=106210) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 01:01:59.615780 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:59.615907 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.context [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4036817-1eea-418e-8a05-ed30a823773a(cell1) {{(pid=106209) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 01:01:59.616194 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:59.617785 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:59.618497 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:59.618933 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:59.619744 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG oslo_concurrency.lockutils [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:59.620231 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG oslo_concurrency.lockutils [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:59.620896 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:59.621812 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG oslo_concurrency.lockutils [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:59.622541 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG oslo_concurrency.lockutils [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:59.623356 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO dbcounter [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] Registered counter for database nova_cell0 Aug 30 01:01:59.623508 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG oslo_concurrency.lockutils [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:59.625507 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG oslo_concurrency.lockutils [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:59.627604 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO dbcounter [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] Registered counter for database nova_cell0 Aug 30 01:01:59.627721 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO dbcounter [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] Registered counter for database nova_cell1 Aug 30 01:01:59.631709 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO dbcounter [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] Registered counter for database nova_cell1 Aug 30 01:01:59.635099 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_db.sqlalchemy.engines [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:01:59.637426 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_db.sqlalchemy.engines [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:01:59.640214 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG oslo_db.sqlalchemy.engines [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:01:59.642414 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG oslo_db.sqlalchemy.engines [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:01:59.643993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writer thread running {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:01:59.645437 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writer thread running {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:01:59.647047 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writer thread running {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:01:59.650289 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writer thread running {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:01:59.787285 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO dbcounter [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] Registered counter for database nova_cell0 Aug 30 01:01:59.793263 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO dbcounter [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] Registered counter for database nova_cell0 Aug 30 01:01:59.793777 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_db.sqlalchemy.engines [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:01:59.799158 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writer thread running {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:01:59.800722 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG oslo_db.sqlalchemy.engines [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:01:59.805045 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writer thread running {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:02:00.247946 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: WARNING keystonemiddleware.auth_token [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:02:00.255315 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: WARNING keystonemiddleware.auth_token [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:02:00.323237 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: WARNING keystonemiddleware.auth_token [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:02:00.330787 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: WARNING keystonemiddleware.auth_token [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:02:00.612274 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: WARNING keystonemiddleware.auth_token [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:02:00.618568 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: WARNING keystonemiddleware.auth_token [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:02:00.624572 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c00bd3f9c0 pid: 106210 (default app) Aug 30 01:02:00.626809 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:00.628026 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001900 Aug 30 01:02:00.628437 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Tue Aug 30 01:02:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:00.684764 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: WARNING keystonemiddleware.auth_token [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:02:00.691721 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: WARNING keystonemiddleware.auth_token [None req-163b2024-b1f2-4951-af00-8e484a8de74a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:02:00.697031 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c00bd3f9c0 pid: 106209 (default app) Aug 30 01:03:24.756611 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:24.757609 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 30 01:03:24.758246 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 30 01:03:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:24.775201 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writing DB stats nova_api:SELECT=3 {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:24.777197 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writing DB stats nova_cell1:SELECT=3 {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:24.778111 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writing DB stats nova_cell0:SELECT=3 {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:24.778987 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:25.654694 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-e33886b3-a301-44ce-a2e1-ca991306947f admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:25.690906 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-e33886b3-a301-44ce-a2e1-ca991306947f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.924837 Aug 30 01:03:25.691460 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Aug 30 01:03:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:28.089457 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:28.090489 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-2015e1ea-401d-44aa-88c9-7e680c6e0431 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 30 01:03:28.093776 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 30 01:03:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:28.578950 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-c5d18185-7031-4f79-9b05-79deffc19890 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "vcpus": 1, "ram": 256, "disk": 1}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:28.683619 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-c5d18185-7031-4f79-9b05-79deffc19890 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.586009 Aug 30 01:03:28.685951 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 30 01:03:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:03:28.698722 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_api:SELECT=3 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:28.699668 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_cell0:SELECT=3 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:28.700597 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_cell1:SELECT=3 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:28.702185 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:28.912361 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-34bb6abf-c299-4925-87b2-c9551e50d3e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:29.086699 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-34bb6abf-c299-4925-87b2-c9551e50d3e7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.393531 Aug 30 01:03:29.087495 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Aug 30 01:03:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:31.491287 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-c5d18185-7031-4f79-9b05-79deffc19890 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:31.492316 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-c5d18185-7031-4f79-9b05-79deffc19890 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 30 01:03:31.492736 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 30 01:03:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:03:32.195155 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-20821532-4587-4387-926c-c7cc1ae5ecde admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "swap": 0, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:32.313676 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-20821532-4587-4387-926c-c7cc1ae5ecde admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.813987 Aug 30 01:03:32.314978 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 30 01:03:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:03:32.327156 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-e0fa71a7-ac89-4866-a265-2d5ed372b3bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:32.473998 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-e0fa71a7-ac89-4866-a265-2d5ed372b3bd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141647 Aug 30 01:03:32.473998 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Aug 30 01:03:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:34.918399 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-20821532-4587-4387-926c-c7cc1ae5ecde admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:34.919407 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-20821532-4587-4387-926c-c7cc1ae5ecde admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 30 01:03:34.919807 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 30 01:03:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:35.335784 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-7da7aae6-c5fe-426a-b37d-644120b1601e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds1G", "id": "d2"}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:35.432785 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-7da7aae6-c5fe-426a-b37d-644120b1601e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506775 Aug 30 01:03:35.433350 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 30 01:03:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:03:35.445715 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-d1590bc2-082e-4f3a-9e21-ece9b5da1745 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:35.533882 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-d1590bc2-082e-4f3a-9e21-ece9b5da1745 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091920 Aug 30 01:03:35.534568 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Aug 30 01:03:35 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:37.940665 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-7da7aae6-c5fe-426a-b37d-644120b1601e admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:37.941585 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-7da7aae6-c5fe-426a-b37d-644120b1601e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 30 01:03:37.943395 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 30 01:03:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:38.405038 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-e6506bc4-43fc-41a7-bcbd-65c3514f8a65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "id": "d3"}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:38.498399 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-e6506bc4-43fc-41a7-bcbd-65c3514f8a65 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.548362 Aug 30 01:03:38.499158 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 30 01:03:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:03:38.512435 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-dae8e77b-44f0-472d-90e9-4e889cc60f87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:38.608212 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-dae8e77b-44f0-472d-90e9-4e889cc60f87 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100411 Aug 30 01:03:38.608907 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Aug 30 01:03:38 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:41.047422 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-e6506bc4-43fc-41a7-bcbd-65c3514f8a65 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:41.047422 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-e6506bc4-43fc-41a7-bcbd-65c3514f8a65 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Aug 30 01:03:41.047422 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 30 01:03:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:41.495480 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-1bfdb362-db96-4210-9961-1af1f14b8c2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "disk": 20, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:41.660836 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-1bfdb362-db96-4210-9961-1af1f14b8c2b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.612572 Aug 30 01:03:41.661568 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 30 01:03:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:03:41.673995 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-e6ef20f6-8c38-4e50-8ca5-46b1b94f6fd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:41.790423 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-e6ef20f6-8c38-4e50-8ca5-46b1b94f6fd0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120155 Aug 30 01:03:41.797344 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Aug 30 01:03:41 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:44.235077 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-1bfdb362-db96-4210-9961-1af1f14b8c2b admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:44.236491 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-1bfdb362-db96-4210-9961-1af1f14b8c2b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002036 Aug 30 01:03:44.237110 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 30 01:03:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:44.697875 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-d7baf2b3-b77b-4cdc-b67c-fbfd58282742 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:44.722812 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-d7baf2b3-b77b-4cdc-b67c-fbfd58282742 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.477333 Aug 30 01:03:44.723322 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Aug 30 01:03:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:03:47.187276 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-1bfdb362-db96-4210-9961-1af1f14b8c2b admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:47.188583 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-1bfdb362-db96-4210-9961-1af1f14b8c2b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002274 Aug 30 01:03:47.189133 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 30 01:03:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:47.662136 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-50c5884f-5510-4fb3-8179-0093f5a4ebbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:47.761319 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-50c5884f-5510-4fb3-8179-0093f5a4ebbe admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.564262 Aug 30 01:03:47.761929 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 30 01:03:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:03:47.777342 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-8adeb90e-5122-40bb-bd22-5b6692e549f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:47.893505 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-8adeb90e-5122-40bb-bd22-5b6692e549f7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.121537 Aug 30 01:03:47.894141 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Aug 30 01:03:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:50.298550 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-50c5884f-5510-4fb3-8179-0093f5a4ebbe admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:50.299553 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-50c5884f-5510-4fb3-8179-0093f5a4ebbe admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 30 01:03:50.299951 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 30 01:03:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:50.729991 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-4423a995-794d-455b-9067-4fb3978daa03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2", "disk": 20, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:50.855143 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-4423a995-794d-455b-9067-4fb3978daa03 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.549000 Aug 30 01:03:50.855718 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 30 01:03:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:03:50.867755 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-86b01597-d64e-4c3b-8964-84c9dee37d32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:51.047862 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-86b01597-d64e-4c3b-8964-84c9dee37d32 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.183944 Aug 30 01:03:51.048643 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Aug 30 01:03:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:53.481542 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-4423a995-794d-455b-9067-4fb3978daa03 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:53.482512 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-4423a995-794d-455b-9067-4fb3978daa03 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 30 01:03:53.482911 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 30 01:03:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:53.870934 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-409e069b-fac9-439a-8828-e3cd95573646 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "id": "3", "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium"}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:53.956369 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-409e069b-fac9-439a-8828-e3cd95573646 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.467085 Aug 30 01:03:53.956918 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 30 01:03:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:03:53.969686 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-babbf0ca-3812-48bc-b9ba-0a2a5e2dff10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:54.080680 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-babbf0ca-3812-48bc-b9ba-0a2a5e2dff10 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114685 Aug 30 01:03:54.081315 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Aug 30 01:03:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:56.588796 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-409e069b-fac9-439a-8828-e3cd95573646 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:56.589900 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-409e069b-fac9-439a-8828-e3cd95573646 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Aug 30 01:03:56.590534 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 30 01:03:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:57.060865 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-4ac921b2-c715-472d-8ec5-cf22d13e77e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "swap": 0, "disk": 80, "name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 8192}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:57.068100 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:57.244078 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-4ac921b2-c715-472d-8ec5-cf22d13e77e1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.645469 Aug 30 01:03:57.244674 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 30 01:03:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:03:57.257223 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-3fd47b34-b1eb-4df6-b36a-cacc5c8dcc2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:57.361654 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-3fd47b34-b1eb-4df6-b36a-cacc5c8dcc2f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108102 Aug 30 01:03:57.362257 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Aug 30 01:03:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:59.775005 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-4ac921b2-c715-472d-8ec5-cf22d13e77e1 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:59.776921 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-4ac921b2-c715-472d-8ec5-cf22d13e77e1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002988 Aug 30 01:03:59.782984 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 30 01:03:59 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:00.254646 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-e017f39e-351f-4f48-b64a-d2bba5d38f1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "disk": 160, "os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:00.408777 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-e017f39e-351f-4f48-b64a-d2bba5d38f1b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.624363 Aug 30 01:04:00.409422 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 30 01:03:59 2022] POST /compute/v2.1/flavors => generated 408 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:04:00.422166 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-a915b0ed-808b-4c80-bbfd-50e1bfd256ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:00.510348 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-a915b0ed-808b-4c80-bbfd-50e1bfd256ab admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091941 Aug 30 01:04:00.510934 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Aug 30 01:04:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:20.942835 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-e017f39e-351f-4f48-b64a-d2bba5d38f1b admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:20.943850 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-e017f39e-351f-4f48-b64a-d2bba5d38f1b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 30 01:04:20.944258 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 30 01:04:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:04:21.361503 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-24ecab26-d763-4ee8-8749-a5afde1b6ac1 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:21.381208 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-24ecab26-d763-4ee8-8749-a5afde1b6ac1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.429874 Aug 30 01:04:21.381766 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Aug 30 01:04:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:04:22.443265 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-e017f39e-351f-4f48-b64a-d2bba5d38f1b admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:22.444270 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-e017f39e-351f-4f48-b64a-d2bba5d38f1b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 30 01:04:22.444667 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 30 01:04:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:22.998227 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-bdae9e00-e6da-4f52-bda5-bd7d32d0e1f2 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:23.003749 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.wsgi [None req-bdae9e00-e6da-4f52-bda5-bd7d32d0e1f2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-bdae9e00-e6da-4f52-bda5-bd7d32d0e1f2 admin admin] Request method failure captured: Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Accept: application/json Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Accept-Encoding: gzip, deflate Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Connection: keep-alive Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Content-Length: 0 Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Host: 10.222.0.52 Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Openstack-Api-Version: compute 2.90 Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Openstack-System-Scope: None Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: User-Agent: python-novaclient Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Auth-Token: gAAAAABjDWIWEhXIUxDoLgHRI68Puvpbpi0ZnoDqCixb1kyONkDbdsJCiShwBc4UAp__c9cZzVOGYRlDGriQ1uvFgnzShT0KrYXc-9gvUDsavV-Gb4WgXyJzesJMBVyMcEsaFKcWA_MUvDfmiRDq9_Y3-WJryNadzOFdny877L6oGALxK2E0yDM Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Domain-Id: None Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Domain-Name: None Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Identity-Status: Confirmed Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Is-Admin-Project: True Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Project-Domain-Id: default Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Project-Domain-Name: Default Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Project-Id: dae85e39d46d422d97a780b67b09cea1 Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Project-Name: admin Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Role: reader,admin,member Aug 30 01:04:23.006988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Roles: reader,admin,member Aug 30 01:04:23.009042 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:04:23.009042 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Tenant: admin Aug 30 01:04:23.009042 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Tenant-Id: dae85e39d46d422d97a780b67b09cea1 Aug 30 01:04:23.009042 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Tenant-Name: admin Aug 30 01:04:23.009042 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-User: admin Aug 30 01:04:23.009042 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-User-Domain-Id: default Aug 30 01:04:23.009042 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-User-Domain-Name: Default Aug 30 01:04:23.009042 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-User-Id: efbdbf875e6a427e9e8f14457c4de416 Aug 30 01:04:23.009042 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-User-Name: admin Aug 30 01:04:23.009042 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: method: > Aug 30 01:04:23.009042 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: exception: Flavor 42 could not be found. Aug 30 01:04:23.009042 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: action_args: {'id': '42'} Aug 30 01:04:23.009042 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:04:23.009042 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:23.009968 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 30 01:04:23.011388 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-bdae9e00-e6da-4f52-bda5-bd7d32d0e1f2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:04:23.012877 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-bdae9e00-e6da-4f52-bda5-bd7d32d0e1f2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.416660 Aug 30 01:04:23.012877 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Aug 30 01:04:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:23.019175 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-fbfff58d-d54d-4835-9fac-470bb966e446 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:23.023998 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:23.043780 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-fbfff58d-d54d-4835-9fac-470bb966e446 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028171 Aug 30 01:04:23.044333 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 30 01:04:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:04:23.054574 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-87e51f4d-6b55-48a0-8665-aaf7fae420fb admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:23.078384 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-87e51f4d-6b55-48a0-8665-aaf7fae420fb admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027489 Aug 30 01:04:23.079046 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 30 01:04:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:04:23.089186 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-1baef6a0-5b04-41e9-ac21-1cb7608688e7 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:23.095130 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.wsgi [None req-1baef6a0-5b04-41e9-ac21-1cb7608688e7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-1baef6a0-5b04-41e9-ac21-1cb7608688e7 admin admin] Request method failure captured: Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Accept: application/json Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Accept-Encoding: gzip, deflate Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Connection: keep-alive Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Content-Length: 0 Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Host: 10.222.0.52 Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Openstack-Api-Version: compute 2.90 Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Openstack-System-Scope: None Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: User-Agent: python-novaclient Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Auth-Token: gAAAAABjDWIWEhXIUxDoLgHRI68Puvpbpi0ZnoDqCixb1kyONkDbdsJCiShwBc4UAp__c9cZzVOGYRlDGriQ1uvFgnzShT0KrYXc-9gvUDsavV-Gb4WgXyJzesJMBVyMcEsaFKcWA_MUvDfmiRDq9_Y3-WJryNadzOFdny877L6oGALxK2E0yDM Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Domain-Id: None Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Domain-Name: None Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Identity-Status: Confirmed Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Is-Admin-Project: True Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Project-Domain-Id: default Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Project-Domain-Name: Default Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Project-Id: dae85e39d46d422d97a780b67b09cea1 Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Project-Name: admin Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Role: reader,admin,member Aug 30 01:04:23.098370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Roles: reader,admin,member Aug 30 01:04:23.099868 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:04:23.099868 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Tenant: admin Aug 30 01:04:23.099868 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Tenant-Id: dae85e39d46d422d97a780b67b09cea1 Aug 30 01:04:23.099868 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Tenant-Name: admin Aug 30 01:04:23.099868 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-User: admin Aug 30 01:04:23.099868 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-User-Domain-Id: default Aug 30 01:04:23.099868 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-User-Domain-Name: Default Aug 30 01:04:23.099868 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-User-Id: efbdbf875e6a427e9e8f14457c4de416 Aug 30 01:04:23.099868 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-User-Name: admin Aug 30 01:04:23.099868 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: method: > Aug 30 01:04:23.099868 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: exception: Flavor 42 could not be found. Aug 30 01:04:23.099868 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: action_args: {'id': '42'} Aug 30 01:04:23.099868 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:04:23.099868 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:23.109354 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 30 01:04:23.110501 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-1baef6a0-5b04-41e9-ac21-1cb7608688e7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:04:23.111503 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-1baef6a0-5b04-41e9-ac21-1cb7608688e7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014879 Aug 30 01:04:23.111503 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Aug 30 01:04:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 01:04:24.173059 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-87e51f4d-6b55-48a0-8665-aaf7fae420fb admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:24.174115 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-87e51f4d-6b55-48a0-8665-aaf7fae420fb admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Aug 30 01:04:24.174573 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 30 01:04:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:24.831617 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-3457af82-69cf-4a6c-9dd7-66c3f2739822 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:24.837449 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.wsgi [None req-3457af82-69cf-4a6c-9dd7-66c3f2739822 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-3457af82-69cf-4a6c-9dd7-66c3f2739822 admin admin] Request method failure captured: Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Accept: application/json Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Accept-Encoding: gzip, deflate Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Connection: keep-alive Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Content-Length: 0 Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Host: 10.222.0.52 Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Openstack-Api-Version: compute 2.90 Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Openstack-System-Scope: None Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: User-Agent: python-novaclient Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Auth-Token: gAAAAABjDWIYpiReZXuFsBX4QZMMsDz4K3CJLuivkSJ2tgkUdjBGrpaX9CF_vb7c0BviVSz0i_KtnVsHQgpblAVgJiMGT8_B5b7QkIuFMIrG-0FJ_3c6SlHLaWWLS43Oi4HASVfsbCjbDSoqiIgLkdvySwOdpZy5GYeEHEBuZ3biavuMYi-oaV8 Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Domain-Id: None Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Domain-Name: None Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Identity-Status: Confirmed Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Is-Admin-Project: True Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Project-Domain-Id: default Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Project-Domain-Name: Default Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Project-Id: dae85e39d46d422d97a780b67b09cea1 Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Project-Name: admin Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Role: reader,admin,member Aug 30 01:04:24.838993 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Roles: reader,admin,member Aug 30 01:04:24.840537 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:04:24.840537 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Tenant: admin Aug 30 01:04:24.840537 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Tenant-Id: dae85e39d46d422d97a780b67b09cea1 Aug 30 01:04:24.840537 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Tenant-Name: admin Aug 30 01:04:24.840537 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-User: admin Aug 30 01:04:24.840537 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-User-Domain-Id: default Aug 30 01:04:24.840537 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-User-Domain-Name: Default Aug 30 01:04:24.840537 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-User-Id: efbdbf875e6a427e9e8f14457c4de416 Aug 30 01:04:24.840537 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-User-Name: admin Aug 30 01:04:24.840537 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: method: > Aug 30 01:04:24.840537 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: exception: Flavor 84 could not be found. Aug 30 01:04:24.840537 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: action_args: {'id': '84'} Aug 30 01:04:24.840537 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:04:24.840537 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:24.841652 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 30 01:04:24.843086 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-3457af82-69cf-4a6c-9dd7-66c3f2739822 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:04:24.844343 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-3457af82-69cf-4a6c-9dd7-66c3f2739822 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.469979 Aug 30 01:04:24.844343 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Aug 30 01:04:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 471 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:24.850164 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-5c71c5b0-e10a-4c57-aea4-c5ebfda6c743 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:24.865582 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-5c71c5b0-e10a-4c57-aea4-c5ebfda6c743 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018967 Aug 30 01:04:24.866164 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 30 01:04:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:04:24.876636 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-80ba6d99-0dc1-4af1-8b5d-92043e160111 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:24.892335 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-80ba6d99-0dc1-4af1-8b5d-92043e160111 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019272 Aug 30 01:04:24.892872 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 30 01:04:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:04:24.902801 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-7d366aac-649a-49d8-8848-4914926b2e41 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:24.908332 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.wsgi [None req-7d366aac-649a-49d8-8848-4914926b2e41 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-7d366aac-649a-49d8-8848-4914926b2e41 admin admin] Request method failure captured: Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Accept: application/json Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Accept-Encoding: gzip, deflate Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Connection: keep-alive Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Content-Length: 0 Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Host: 10.222.0.52 Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Openstack-Api-Version: compute 2.90 Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Openstack-System-Scope: None Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: User-Agent: python-novaclient Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Auth-Token: gAAAAABjDWIYpiReZXuFsBX4QZMMsDz4K3CJLuivkSJ2tgkUdjBGrpaX9CF_vb7c0BviVSz0i_KtnVsHQgpblAVgJiMGT8_B5b7QkIuFMIrG-0FJ_3c6SlHLaWWLS43Oi4HASVfsbCjbDSoqiIgLkdvySwOdpZy5GYeEHEBuZ3biavuMYi-oaV8 Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Domain-Id: None Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Domain-Name: None Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Identity-Status: Confirmed Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Is-Admin-Project: True Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Project-Domain-Id: default Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Project-Domain-Name: Default Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Project-Id: dae85e39d46d422d97a780b67b09cea1 Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Project-Name: admin Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Role: reader,admin,member Aug 30 01:04:24.909905 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Roles: reader,admin,member Aug 30 01:04:24.912047 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:04:24.912047 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Tenant: admin Aug 30 01:04:24.912047 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Tenant-Id: dae85e39d46d422d97a780b67b09cea1 Aug 30 01:04:24.912047 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Tenant-Name: admin Aug 30 01:04:24.912047 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-User: admin Aug 30 01:04:24.912047 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-User-Domain-Id: default Aug 30 01:04:24.912047 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-User-Domain-Name: Default Aug 30 01:04:24.912047 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-User-Id: efbdbf875e6a427e9e8f14457c4de416 Aug 30 01:04:24.912047 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-User-Name: admin Aug 30 01:04:24.912047 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: method: > Aug 30 01:04:24.912047 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: exception: Flavor 84 could not be found. Aug 30 01:04:24.912047 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: action_args: {'id': '84'} Aug 30 01:04:24.912047 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:04:24.912047 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:24.912941 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 30 01:04:24.914567 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-7d366aac-649a-49d8-8848-4914926b2e41 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:04:24.915812 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-7d366aac-649a-49d8-8848-4914926b2e41 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012427 Aug 30 01:04:24.915812 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Aug 30 01:04:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 01:04:25.891024 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-80ba6d99-0dc1-4af1-8b5d-92043e160111 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:25.892013 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-80ba6d99-0dc1-4af1-8b5d-92043e160111 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 30 01:04:25.892402 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 30 01:04:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:26.447784 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-dfbdad56-fdac-408f-899a-e0b2e0add891 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:26.453640 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.wsgi [None req-dfbdad56-fdac-408f-899a-e0b2e0add891 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-dfbdad56-fdac-408f-899a-e0b2e0add891 admin admin] Request method failure captured: Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Accept: application/json Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Accept-Encoding: gzip, deflate Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Connection: keep-alive Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Content-Length: 0 Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Host: 10.222.0.52 Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Openstack-Api-Version: compute 2.90 Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Openstack-System-Scope: None Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: User-Agent: python-novaclient Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Auth-Token: gAAAAABjDWIZPt2OyPqQnDyQhKYGaccsOIxCoz71XQTP1gG-KaAvBdx_H3NpNeGDy-kKlvH0hA7NX7ddXrVD3iIAv9RGxrfemzvzCeOcC83HlDf2eP3wTMCZyA33gzb_-nxqTc4SOnJvULlO7Wq0D54cFoQQRAL4iTJhrL6_S5MQQNinqHO5amY Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Domain-Id: None Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Domain-Name: None Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Identity-Status: Confirmed Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Is-Admin-Project: True Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Project-Domain-Id: default Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Project-Domain-Name: Default Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Project-Id: dae85e39d46d422d97a780b67b09cea1 Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Project-Name: admin Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Role: reader,admin,member Aug 30 01:04:26.455182 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Roles: reader,admin,member Aug 30 01:04:26.456937 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:04:26.456937 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Tenant: admin Aug 30 01:04:26.456937 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Tenant-Id: dae85e39d46d422d97a780b67b09cea1 Aug 30 01:04:26.456937 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-Tenant-Name: admin Aug 30 01:04:26.456937 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-User: admin Aug 30 01:04:26.456937 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-User-Domain-Id: default Aug 30 01:04:26.456937 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-User-Domain-Name: Default Aug 30 01:04:26.456937 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-User-Id: efbdbf875e6a427e9e8f14457c4de416 Aug 30 01:04:26.456937 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: X-User-Name: admin Aug 30 01:04:26.456937 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: method: > Aug 30 01:04:26.456937 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: exception: Flavor 451 could not be found. Aug 30 01:04:26.456937 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: action_args: {'id': '451'} Aug 30 01:04:26.456937 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:04:26.456937 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:26.457936 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: ERROR nova.api.openstack.wsgi Aug 30 01:04:26.458967 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-dfbdad56-fdac-408f-899a-e0b2e0add891 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:04:26.459980 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-dfbdad56-fdac-408f-899a-e0b2e0add891 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.422265 Aug 30 01:04:26.459980 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 30 01:04:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 01:04:26.467063 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-3fde982c-229f-4cc9-9682-7cad8d3e703e admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:26.482887 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-3fde982c-229f-4cc9-9682-7cad8d3e703e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019439 Aug 30 01:04:26.485305 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 30 01:04:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:04:26.493522 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-d8c4c5e4-0438-4aee-85cf-219cf5e406fe admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:26.508975 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-d8c4c5e4-0438-4aee-85cf-219cf5e406fe admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019321 Aug 30 01:04:26.509527 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 30 01:04:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:04:26.519186 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-68c20676-9a9b-4133-8454-519720f60fed admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:26.525859 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.wsgi [None req-68c20676-9a9b-4133-8454-519720f60fed admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-68c20676-9a9b-4133-8454-519720f60fed admin admin] Request method failure captured: Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Accept: application/json Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Accept-Encoding: gzip, deflate Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Connection: keep-alive Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Content-Length: 0 Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Host: 10.222.0.52 Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Openstack-Api-Version: compute 2.90 Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Openstack-System-Scope: None Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: User-Agent: python-novaclient Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Auth-Token: gAAAAABjDWIZPt2OyPqQnDyQhKYGaccsOIxCoz71XQTP1gG-KaAvBdx_H3NpNeGDy-kKlvH0hA7NX7ddXrVD3iIAv9RGxrfemzvzCeOcC83HlDf2eP3wTMCZyA33gzb_-nxqTc4SOnJvULlO7Wq0D54cFoQQRAL4iTJhrL6_S5MQQNinqHO5amY Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Domain-Id: None Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Domain-Name: None Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Identity-Status: Confirmed Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Is-Admin-Project: True Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Project-Domain-Id: default Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Project-Domain-Name: Default Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Project-Id: dae85e39d46d422d97a780b67b09cea1 Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Project-Name: admin Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Role: reader,admin,member Aug 30 01:04:26.527373 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Roles: reader,admin,member Aug 30 01:04:26.529061 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dae85e39d46d422d97a780b67b09cea1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:04:26.529061 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Tenant: admin Aug 30 01:04:26.529061 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Tenant-Id: dae85e39d46d422d97a780b67b09cea1 Aug 30 01:04:26.529061 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-Tenant-Name: admin Aug 30 01:04:26.529061 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-User: admin Aug 30 01:04:26.529061 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-User-Domain-Id: default Aug 30 01:04:26.529061 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-User-Domain-Name: Default Aug 30 01:04:26.529061 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-User-Id: efbdbf875e6a427e9e8f14457c4de416 Aug 30 01:04:26.529061 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: X-User-Name: admin Aug 30 01:04:26.529061 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: method: > Aug 30 01:04:26.529061 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: exception: Flavor 451 could not be found. Aug 30 01:04:26.529061 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: action_args: {'id': '451'} Aug 30 01:04:26.529061 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:04:26.529061 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:26.530021 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: ERROR nova.api.openstack.wsgi Aug 30 01:04:26.531251 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-68c20676-9a9b-4133-8454-519720f60fed admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:04:26.532456 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-68c20676-9a9b-4133-8454-519720f60fed admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013261 Aug 30 01:04:26.532456 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 30 01:04:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:04:27.500988 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-d8c4c5e4-0438-4aee-85cf-219cf5e406fe admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:27.502020 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-d8c4c5e4-0438-4aee-85cf-219cf5e406fe admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 30 01:04:27.502418 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 30 01:04:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:28.076443 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-ca73930c-d2fe-4add-b53d-f4e452d8eee6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:28.218704 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-ca73930c-d2fe-4add-b53d-f4e452d8eee6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.577355 Aug 30 01:04:28.219185 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Aug 30 01:04:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:04:29.205778 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-d8c4c5e4-0438-4aee-85cf-219cf5e406fe admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:29.206878 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-d8c4c5e4-0438-4aee-85cf-219cf5e406fe admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Aug 30 01:04:29.207279 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 30 01:04:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:29.863515 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-add37059-a355-49a0-a770-7475a5c84bcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:29.961212 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-add37059-a355-49a0-a770-7475a5c84bcc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.615834 Aug 30 01:04:29.961784 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Aug 30 01:04:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:04:30.934011 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-d8c4c5e4-0438-4aee-85cf-219cf5e406fe admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:30.935026 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-d8c4c5e4-0438-4aee-85cf-219cf5e406fe admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 30 01:04:30.935807 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 30 01:04:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:31.465868 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-cf07ff9d-55a3-4be9-9d71-c71d76c04a18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:31.585133 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-cf07ff9d-55a3-4be9-9d71-c71d76c04a18 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.511933 Aug 30 01:04:31.586260 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Aug 30 01:04:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:04:32.562472 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-d8c4c5e4-0438-4aee-85cf-219cf5e406fe admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:32.563551 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-d8c4c5e4-0438-4aee-85cf-219cf5e406fe admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Aug 30 01:04:32.563958 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 30 01:04:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:33.097565 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-c4c7dd72-05a4-460c-8c06-6ec398264d44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:33.189832 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-c4c7dd72-05a4-460c-8c06-6ec398264d44 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.482702 Aug 30 01:04:33.190388 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Aug 30 01:04:32 2022] POST /compute/v2.1/flavors => generated 409 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:04:34.172393 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-d8c4c5e4-0438-4aee-85cf-219cf5e406fe admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:34.173396 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-d8c4c5e4-0438-4aee-85cf-219cf5e406fe admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 30 01:04:34.173820 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 30 01:04:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:34.711403 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-a6c151ca-1987-4005-9f21-8f51f0bfd236 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:34.732869 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-a6c151ca-1987-4005-9f21-8f51f0bfd236 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.420930 Aug 30 01:04:34.733419 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Tue Aug 30 01:04:34 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:05:29.061447 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-d8c4c5e4-0438-4aee-85cf-219cf5e406fe admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:29.062562 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-d8c4c5e4-0438-4aee-85cf-219cf5e406fe admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Aug 30 01:05:29.062989 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 30 01:05:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:05:29.074287 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:29.469142 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-2ac44973-9e8f-4404-a5cc-89f67deec56a admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:29.490370 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-2ac44973-9e8f-4404-a5cc-89f67deec56a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.420578 Aug 30 01:05:29.490917 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Aug 30 01:05:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:05:29.512253 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG dbcounter [-] [106209] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:29.516115 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-3401016d-d83a-47d7-8e18-6ed8999a7ecf admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:29.524462 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-3401016d-d83a-47d7-8e18-6ed8999a7ecf admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013753 Aug 30 01:05:29.524992 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1283 bytes} [Tue Aug 30 01:05:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:29.537562 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-1e247ecd-54d4-415f-a4b5-0c5f06599794 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:29.545495 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-1e247ecd-54d4-415f-a4b5-0c5f06599794 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012093 Aug 30 01:05:29.546059 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1286 bytes} [Tue Aug 30 01:05:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:29.557985 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-9e29e919-72c2-4352-88a5-87e3792162e4 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:29.569789 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-9e29e919-72c2-4352-88a5-87e3792162e4 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012147 Aug 30 01:05:29.569789 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1286 bytes} [Tue Aug 30 01:05:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:29.579209 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-b9a8f2be-b167-4c1d-8ab8-f8e3d7c38705 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:29.587954 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-b9a8f2be-b167-4c1d-8ab8-f8e3d7c38705 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012412 Aug 30 01:05:29.588500 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1283 bytes} [Tue Aug 30 01:05:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:41.335258 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-9e29e919-72c2-4352-88a5-87e3792162e4 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:41.336996 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-9e29e919-72c2-4352-88a5-87e3792162e4 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002195 Aug 30 01:08:41.337564 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 30 01:08:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:08:41.478319 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_api:SELECT=6 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:41.642539 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-f3d439ca-5a96-403b-b53e-7adc9cd2f8ba admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:41.646010 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-f3d439ca-5a96-403b-b53e-7adc9cd2f8ba admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:41.646483 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-f3d439ca-5a96-403b-b53e-7adc9cd2f8ba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:41.646912 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-f3d439ca-5a96-403b-b53e-7adc9cd2f8ba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:41.647615 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-f3d439ca-5a96-403b-b53e-7adc9cd2f8ba admin admin] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:41.648053 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-f3d439ca-5a96-403b-b53e-7adc9cd2f8ba admin admin] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:41.648466 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-f3d439ca-5a96-403b-b53e-7adc9cd2f8ba admin admin] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:41.682628 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-f3d439ca-5a96-403b-b53e-7adc9cd2f8ba admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.205880 Aug 30 01:08:41.683195 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 30 01:08:41 2022] GET /compute/v2.1/os-services => generated 794 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:08:42.526136 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-9e29e919-72c2-4352-88a5-87e3792162e4 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:42.527144 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-9e29e919-72c2-4352-88a5-87e3792162e4 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 30 01:08:42.527571 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 30 01:08:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:08:42.722204 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-e015924a-7a07-4f74-9a91-d37e8d88309c admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:42.725610 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-e015924a-7a07-4f74-9a91-d37e8d88309c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:42.726075 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-e015924a-7a07-4f74-9a91-d37e8d88309c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:42.726502 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-e015924a-7a07-4f74-9a91-d37e8d88309c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:42.727204 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-e015924a-7a07-4f74-9a91-d37e8d88309c admin admin] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:42.727645 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-e015924a-7a07-4f74-9a91-d37e8d88309c admin admin] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:42.728056 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-e015924a-7a07-4f74-9a91-d37e8d88309c admin admin] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:42.747422 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-e015924a-7a07-4f74-9a91-d37e8d88309c admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077805 Aug 30 01:08:42.747984 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 30 01:08:42 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:08:54.045791 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-9e29e919-72c2-4352-88a5-87e3792162e4 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:54.046960 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-9e29e919-72c2-4352-88a5-87e3792162e4 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Aug 30 01:08:54.047487 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 30 01:08:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:08:54.194439 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_cell0:SELECT=4 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:54.195163 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_cell1:SELECT=4 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:54.195766 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG dbcounter [-] [106210] Writing DB stats nova_api:SELECT=8 {{(pid=106210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:54.244583 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-5fd1b4fc-dfb2-4bc3-bb0d-7d5e9fab0105 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:54.248094 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-5fd1b4fc-dfb2-4bc3-bb0d-7d5e9fab0105 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:54.248601 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-5fd1b4fc-dfb2-4bc3-bb0d-7d5e9fab0105 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:54.249030 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-5fd1b4fc-dfb2-4bc3-bb0d-7d5e9fab0105 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:54.249776 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-5fd1b4fc-dfb2-4bc3-bb0d-7d5e9fab0105 admin admin] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:54.250236 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-5fd1b4fc-dfb2-4bc3-bb0d-7d5e9fab0105 admin admin] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:54.250755 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-5fd1b4fc-dfb2-4bc3-bb0d-7d5e9fab0105 admin admin] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:54.276552 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-5fd1b4fc-dfb2-4bc3-bb0d-7d5e9fab0105 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.086552 Aug 30 01:08:54.277116 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 30 01:08:54 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:08:55.127595 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: DEBUG nova.api.openstack.wsgi [None req-9e29e919-72c2-4352-88a5-87e3792162e4 admin admin] Calling method '>' {{(pid=106209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:55.128659 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: INFO nova.api.openstack.requestlog [None req-9e29e919-72c2-4352-88a5-87e3792162e4 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 30 01:08:55.129059 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: [pid: 106209|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 30 01:08:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:08:55.326532 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG nova.api.openstack.wsgi [None req-bf3990cb-6fc4-41fd-8e24-f285ce536957 admin admin] Calling method '>' {{(pid=106210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:55.330687 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-bf3990cb-6fc4-41fd-8e24-f285ce536957 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:55.331161 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-bf3990cb-6fc4-41fd-8e24-f285ce536957 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:55.331595 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-bf3990cb-6fc4-41fd-8e24-f285ce536957 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:55.332304 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-bf3990cb-6fc4-41fd-8e24-f285ce536957 admin admin] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:55.332801 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-bf3990cb-6fc4-41fd-8e24-f285ce536957 admin admin] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:55.333169 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: DEBUG oslo_concurrency.lockutils [None req-bf3990cb-6fc4-41fd-8e24-f285ce536957 admin admin] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:55.355642 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: INFO nova.api.openstack.requestlog [None req-bf3990cb-6fc4-41fd-8e24-f285ce536957 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.085192 Aug 30 01:08:55.366706 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: [pid: 106210|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 30 01:08:55 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:09:53.645858 dv-cinder-815712-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 01:09:53.646743 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: Tue Aug 30 01:09:53 2022 - graceful shutdown triggered... Aug 30 01:09:53.647244 dv-cinder-815712-11-iscsi devstack@n-api.service[106209]: Gracefully killing worker 1 (pid: 106209)... Aug 30 01:09:53.647607 dv-cinder-815712-11-iscsi devstack@n-api.service[106210]: Gracefully killing worker 2 (pid: 106210)... Aug 30 01:09:54.647908 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: worker 1 buried after 1 seconds Aug 30 01:09:54.648445 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: worker 2 buried after 1 seconds Aug 30 01:09:54.648445 dv-cinder-815712-11-iscsi devstack@n-api.service[106208]: goodbye to uWSGI. Aug 30 01:09:54.649489 dv-cinder-815712-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 30 01:09:54.650079 dv-cinder-815712-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 01:09:54.653037 dv-cinder-815712-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 01:09:54.663312 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 01:09:54.665371 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 01:09:54 2022] *** Aug 30 01:09:54.665371 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 01:09:54.665371 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 01:09:54.665371 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: nodename: dv-cinder-815712-11-iscsi Aug 30 01:09:54.665371 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: machine: x86_64 Aug 30 01:09:54.665371 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: clock source: unix Aug 30 01:09:54.665371 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: pcre jit disabled Aug 30 01:09:54.665371 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: detected number of CPU cores: 4 Aug 30 01:09:54.665371 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: current working directory: / Aug 30 01:09:54.665371 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: detected binary path: /usr/bin/uwsgi-core Aug 30 01:09:54.665371 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: your processes number limit is 47680 Aug 30 01:09:54.665371 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: your memory page size is 4096 bytes Aug 30 01:09:54.665371 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: detected max file descriptor number: 2048 Aug 30 01:09:54.665371 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: lock engine: pthread robust mutexes Aug 30 01:09:54.666337 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: thunder lock: enabled Aug 30 01:09:54.666337 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 01:09:54.666337 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 01:09:54.706295 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: Python main interpreter initialized at 0x561f4ebfe9c0 Aug 30 01:09:54.706295 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: python threads support enabled Aug 30 01:09:54.706295 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: your server socket listen backlog is limited to 100 connections Aug 30 01:09:54.706295 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: your mercy for graceful operations on workers is 90 seconds Aug 30 01:09:54.706740 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 01:09:54.706740 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: *** Operational MODE: preforking *** Aug 30 01:09:54.706740 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: *** uWSGI is running in multiple interpreter mode *** Aug 30 01:09:54.706740 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: spawned uWSGI master process (pid: 121214) Aug 30 01:09:54.706938 dv-cinder-815712-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 01:09:54.710042 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: spawned uWSGI worker 1 (pid: 121232, cores: 1) Aug 30 01:09:54.710640 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: spawned uWSGI worker 2 (pid: 121233, cores: 1) Aug 30 01:09:54.710984 dv-cinder-815712-11-iscsi devstack@n-api.service[121214]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 01:09:55.376063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 01:09:55.397504 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 01:09:56.533201 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:09:56.533201 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: from cryptography.utils import int_from_bytes Aug 30 01:09:56.534023 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:09:56.534023 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: from cryptography.utils import int_from_bytes Aug 30 01:09:56.582033 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:09:56.582033 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: from cryptography.utils import int_from_bytes Aug 30 01:09:56.582600 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:09:56.582600 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: from cryptography.utils import int_from_bytes Aug 30 01:09:59.012496 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:09:59.013118 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:09:59.013438 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:09:59.013656 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:09:59.013918 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:09:59.014317 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.014645 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.014967 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.015286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.016328 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.016646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.016972 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.017293 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.017624 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.017912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.018232 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.018557 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815712-11-iscsi {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.018880 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.019190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.019502 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.019825 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.020130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.020452 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.020762 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.021276 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.022772 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.022772 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.022772 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.022772 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.023119 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.023321 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.023579 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.023889 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.024228 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.024516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.024926 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815712-11-iscsi {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.025240 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.025560 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.025887 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.026311 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.026630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.026930 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.027252 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.027575 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.027899 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.028223 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.028549 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.028860 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.029180 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.029479 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.029801 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.030132 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.030457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.030751 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.031061 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.031314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.032194 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.032520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.032841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.033515 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.033515 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.033666 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.033966 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.034283 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.034588 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.035133 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.035238 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.035503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.035799 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.036103 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.036405 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.036712 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.037031 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.037344 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.037665 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.037997 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.038316 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.038718 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.038968 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.039276 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.039618 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.039936 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.040242 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.040559 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.040883 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.041190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.041495 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.041822 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.042143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.042476 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.042779 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.043027 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.043328 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.043631 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.043947 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.044252 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.044561 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.044865 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.045163 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.045470 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.045714 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:09:59.046269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.046640 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:09:59.046844 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.046844 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.047151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:09:59.047329 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.047477 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:09:59.047630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.047791 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:09:59.048101 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.048279 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.048438 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.048612 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.048767 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.048938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.049037 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.049131 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.049223 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.049223 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.049418 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.049520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.049607 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.049714 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.049849 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.049963 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.050317 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.050417 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.050512 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.050682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.050849 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.051028 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.051133 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.051313 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.051421 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815712-11-iscsi {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.051619 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.051727 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.051923 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.052018 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.052242 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.052337 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.052551 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.052652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.052858 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.052961 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.053176 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.053270 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.053476 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.053571 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.053809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.054006 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.054123 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.054322 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.054427 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.054632 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.054733 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.054946 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.055047 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.055285 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.055385 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.055588 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.055690 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.055889 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.055989 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.056189 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.056345 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.056507 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.056645 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.056785 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.056916 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.057077 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.057220 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.057381 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.057515 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815712-11-iscsi {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.057686 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.057875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.058008 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.058146 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.058302 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.058437 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.058617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.058853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.058989 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.059169 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.059311 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.059481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.059629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.059806 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.059942 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.060132 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.060278 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.060444 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.060586 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.060768 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.060905 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.061091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.061219 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.061412 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.061555 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.061756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.061904 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.062065 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.062210 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.062356 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.062493 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.063201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.063345 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.063525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.063750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.064096 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.064233 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.065092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.065092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.065393 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.065558 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.065704 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.065880 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.066034 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.066215 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.066370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.066370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.066666 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.066666 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.066967 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.067111 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.067268 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.067422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.067575 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.067727 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.067881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.068034 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.068188 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.068335 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.068479 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.069914 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.070074 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.070214 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.070358 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.070492 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.070492 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.070750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.070888 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.071029 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.071167 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.071306 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.071439 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.071577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.071716 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.071860 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.071992 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.072122 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.072259 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.072390 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.072521 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.072670 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.072803 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.072915 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.073033 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.073154 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.073276 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.073401 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.073544 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.073684 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.073831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.073943 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.074065 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.074177 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.074295 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.074414 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.074533 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.074644 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.074767 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.074890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.074890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.076043 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.076184 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.076316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.076457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.076591 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.076730 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.076862 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.077006 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.077146 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.077287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.077426 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.077558 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.077695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.077881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.078015 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.078155 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.078362 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.079015 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.079223 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.079407 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.079552 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.079692 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.079856 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.079989 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.080127 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.080266 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.080406 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.080406 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.080662 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.080792 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.080923 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.080923 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.081188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.081318 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.081456 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.081594 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.081741 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.081887 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.082029 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.082170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.082311 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.082442 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.082572 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.082715 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.082857 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.082998 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.083138 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.083276 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.083406 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.083543 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.083673 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.083819 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.083958 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.084098 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.084238 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.084370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.084500 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.084629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.084766 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.084910 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.085050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.085188 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.085326 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.085464 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.085595 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.085748 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.085881 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.086025 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.086159 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.086297 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.086443 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.086587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.086726 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.086856 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.086995 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.087126 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.087246 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.087371 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.087482 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.087599 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.087717 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.087828 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.087948 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.088057 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.088156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.088247 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.088339 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.088436 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.088534 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.088625 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.088709 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.088791 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.088880 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.088963 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.089055 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.089140 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.089224 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.089316 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.089408 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.089499 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.089660 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.089819 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.089907 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.090041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.090192 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.090348 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.090450 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.090652 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.090743 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.090972 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.091069 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:09:59.091287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.091381 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.091598 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.091743 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.091905 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.092060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.092210 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.092350 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.092534 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.092670 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.092840 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.092982 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.093181 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.093329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.093510 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.093651 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.094008 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.094169 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.094311 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.094443 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.094621 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.094761 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.094900 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.095041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.095198 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.095334 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.095523 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.095667 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.095846 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.095993 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.096160 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.096325 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.096480 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.096616 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.096793 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.096937 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.097112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.097253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.097422 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.097565 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.097827 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.097981 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.098115 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.098253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.098385 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.098514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.098654 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.098799 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.098968 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.099136 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.099306 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.099484 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.099637 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.099802 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.099938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.100133 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.100277 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.100460 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.100609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.100777 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.100993 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.101126 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.101265 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.101412 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.101543 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.101709 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.101849 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.102060 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.102169 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.102376 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.102477 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.102682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.102782 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.102999 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.103110 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.103308 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.103419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.103628 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.103728 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.103933 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.104035 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.104246 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.104354 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.104546 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.104655 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.104858 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.104961 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.105186 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.105296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.105503 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.105603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.105833 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.105950 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.106149 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.106257 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.106465 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.106566 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.106776 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.106878 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.107085 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.107180 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.107394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.107495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.107698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.107801 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.108005 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.108099 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.108311 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.108409 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.108621 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.108723 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.108928 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.109028 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.109233 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.109342 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.109564 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.109838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.110019 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.110207 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.110371 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.110526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.110683 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.110830 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.110982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.111127 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.111271 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.111415 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.111567 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.111711 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.111887 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.112054 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.112228 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.112383 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.112540 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.112685 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.112836 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.112987 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.113147 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.113306 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.113458 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.113792 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.113984 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.114156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.114316 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.114472 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.114624 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.114776 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.114928 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.115071 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.115222 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.115376 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.115545 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.115703 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.115856 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.116008 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.116208 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.116368 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.116513 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.116664 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.116808 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.116951 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.117108 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.117267 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.117432 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.117615 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.117835 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.118014 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.118170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.118332 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.118491 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.118643 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.118794 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.118945 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.119166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.119348 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.119518 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.119666 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.119809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.119952 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.120105 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.120258 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.120413 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.120564 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.120709 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.120862 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.121598 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.121829 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.121983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.122140 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.122292 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.122448 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.122601 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.122744 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.122911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.123063 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.123063 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.123357 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.123509 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.123662 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.123814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.123960 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.124102 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.124260 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.124405 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.124547 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.124698 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.124860 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.125016 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.125692 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.125875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.126029 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.126220 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.126371 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.126522 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.126665 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.126808 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.126950 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.127104 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.127248 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.127408 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.127560 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.127704 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.127854 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.128008 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.128161 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.128305 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.128447 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.128589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.128745 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.128896 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.129047 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.129192 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.129346 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.129489 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.129645 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.129830 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.129982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.130126 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.130280 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.130425 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.130582 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.130734 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.130884 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.131027 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.131182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.131334 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.131493 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.131493 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.131775 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.131919 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.132062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.132223 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.132377 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.132537 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.132705 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.132857 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.133009 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.133176 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.133322 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.133472 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.133623 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.133796 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.133950 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.134102 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.134246 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.134390 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.134541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.134691 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.134842 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.134994 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.135157 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.135309 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.135454 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.135597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.135750 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.135902 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.136046 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.136188 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.136339 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.136483 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.136636 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.136867 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.137024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.137188 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.137340 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.137486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.137643 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.137847 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.138006 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.138159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.138310 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.138463 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.138609 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.138751 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.138895 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.139048 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.139200 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.139354 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.139506 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.139659 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.139822 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.139975 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.140130 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.140284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.140284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.140558 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.140952 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.141607 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.141795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.141961 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.142108 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.142262 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.142407 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.142551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.142707 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.142860 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.143004 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.143155 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.143301 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.143444 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.143719 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.143886 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.144039 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.144192 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.144335 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.144478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.144632 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.144784 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.144929 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.145080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.145224 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.145374 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.145536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.145681 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.145906 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.146066 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.146211 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.146367 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.146519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.146664 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.146807 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.146993 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.147137 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.147290 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.147441 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.147586 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.147729 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.147896 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.148049 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.148225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.148374 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.148518 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.148661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.148819 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.148963 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.149122 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.149275 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.149426 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.149579 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.149758 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.149934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.149934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.150209 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.150360 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.150512 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.150663 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.150821 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.150972 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.151117 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.151269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.151427 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.151578 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.151746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.151899 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.152053 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.152204 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.152364 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.152516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.152673 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.152825 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.152976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.153120 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.153265 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.153418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.153569 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.153759 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.153927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.154081 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.154224 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.154383 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.154536 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.154679 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.154838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.154981 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.155124 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.155276 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.155421 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.155564 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.155723 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.155866 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.156009 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.156166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.156166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.156488 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.156633 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.156792 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.156952 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.157114 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.157272 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.157426 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.157578 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.157763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.157928 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.158081 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.158235 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.158235 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.158531 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.158676 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.158826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.158979 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.159123 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.159274 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.159431 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.159596 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.159756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.159918 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.160063 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.160220 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.160374 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.160527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.160682 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.160826 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.160969 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.161120 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.161264 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.161415 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.161577 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.161723 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.161921 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.162075 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.162219 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.162371 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.162514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.162666 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.162817 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.162976 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.163120 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.163271 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.163415 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.163576 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.163736 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.163881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.164039 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.164183 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.164327 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.164469 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.164622 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.164767 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.164910 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.165052 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.165203 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.165364 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.165518 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.165662 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.165836 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.165982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.166126 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.166270 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.166430 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.166582 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.166727 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.166886 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.167030 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.167187 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.167350 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.167495 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.167638 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.167781 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.167932 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.168090 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.168309 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.168462 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.168605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.168757 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.168902 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.169056 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.169210 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.169365 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.169523 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.169675 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.169873 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.170011 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.170115 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.170205 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.170299 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.170386 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.170561 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.170663 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.170755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.170845 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.170957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.171044 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.171153 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.171235 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.171326 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.171418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.171511 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.171602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.171699 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.171784 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.171873 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.171973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.172067 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.172067 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.172291 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.172291 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.172610 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.172610 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.172917 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.172917 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.173150 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.173239 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.173325 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.173415 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.173506 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.173599 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.173680 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.173822 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.173919 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.174039 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.174209 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.174372 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.174525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.174670 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.174820 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.174979 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.175387 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.175552 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.175724 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.175876 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.176035 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.176186 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.176352 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.176503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.176663 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.176822 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.176982 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.177132 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.177297 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.177449 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.177606 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.177794 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.177953 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.178104 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.178266 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.178428 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.178580 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.178730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.178880 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.179055 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.179287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.179456 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.179616 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.179785 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.179946 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.180112 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.180271 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.180423 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.180583 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.180734 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.180892 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.181052 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.181240 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.181398 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.181559 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.181711 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.181904 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.182090 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.182256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.182416 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.182652 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.182821 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.182971 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.183131 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.183310 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.183461 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.183620 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.183779 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.183941 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.184113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.184272 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.184432 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.184592 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.184751 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.184911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.184911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.185239 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.185401 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.185553 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.185705 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.185929 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.186091 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.186262 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.186414 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.186564 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.186722 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.186884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.187035 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.187185 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.187335 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.187485 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.188162 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.188325 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.188477 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.188638 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.188798 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.188951 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.189118 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.189278 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.189431 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.189589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.189759 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.189917 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.190085 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.190239 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.190390 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.190548 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.190731 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.190893 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.191109 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.191282 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.191445 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.191445 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.191917 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.192114 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.192277 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.192430 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.192581 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.192733 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.192892 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.193066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.193219 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.193371 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.193534 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.193695 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.193903 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.194058 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.194210 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.194361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.194520 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.194727 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.194894 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.195046 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.195217 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.195369 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.195527 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.195698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.195851 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.196016 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.196176 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.196337 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.196489 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.196653 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.196837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.197002 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.197175 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.197329 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.197495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.197647 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.197836 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.198000 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.198153 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.198305 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.198474 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.198627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.198784 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.198935 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.199093 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.199267 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.199430 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.199584 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.199751 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.199904 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.200063 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.200215 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.200215 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.200515 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.200667 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.200818 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.200969 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.201119 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.201295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.201457 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.201617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.201833 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.202004 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.202168 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.202168 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.202467 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.202630 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.202782 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.202940 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.203107 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.203849 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.204015 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.204168 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.204473 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.204649 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.204814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.204975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.205138 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.205290 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.205449 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.205612 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.205834 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.205834 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.206160 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.206321 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.206481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.206648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.206802 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.206953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.207104 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.207255 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.207406 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.207571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.207725 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.207885 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.208062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.208242 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.208411 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.208572 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.208725 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.208878 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.209029 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.209180 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.209350 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.209512 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.209663 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.209864 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.210030 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.210194 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.210357 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.210509 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.210661 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.210812 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.210963 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.211123 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.211282 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.211443 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.211595 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.211755 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.211755 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.212083 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.212245 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.212403 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.212556 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.212715 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.212875 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.213038 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.213191 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.213350 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.213524 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.213701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.213919 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.214132 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.214298 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.214477 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.214716 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.214870 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.215076 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.215235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.215392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.215521 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.215521 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.215697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.215801 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.215933 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.216040 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.216127 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.216229 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.216326 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.216422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.216509 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.216594 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.216696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.216783 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.216883 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.216977 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.217063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.217148 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.217245 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.217334 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.217428 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.217515 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.217599 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.217683 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.217803 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.217892 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.217992 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.218079 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.218171 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.218265 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.218350 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.218442 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.218536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.218634 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.218720 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.218847 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.218951 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.219056 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.219155 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.219237 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.219422 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.219621 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.219789 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.220050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.220263 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.220436 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.220597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.220757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.220910 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.221077 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.221239 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.221400 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.221562 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.221714 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.221912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.222075 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.222250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.222411 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.222563 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.222730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.222892 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.223044 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.223203 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.223356 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.223516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.223676 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.223839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.223839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.224453 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.224650 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.224823 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.224978 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.225167 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.225330 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.225504 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.225660 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.225868 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.226022 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.226226 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.226385 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.226536 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.226701 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.226852 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.227018 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.227183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.227336 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.227498 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.227650 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.227801 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.227967 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.228119 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.228272 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.228475 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.228650 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.228815 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.228977 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.229129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.229289 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.229440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.229600 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.229774 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.229945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.230098 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.230250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.230411 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.230563 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.230762 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.230940 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.231093 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.231244 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.231402 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.231567 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.231729 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.231892 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.232044 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.232204 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.232356 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.232507 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.232672 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.232834 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.233002 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.233154 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.233313 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.233507 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.233691 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.233892 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.234056 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.234208 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.234378 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.234378 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.234833 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.234995 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.235159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.235311 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.235462 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.235626 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.235788 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.235947 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.236100 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.236259 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.236418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.236418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.236418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.236857 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.237015 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.237187 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.237340 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.237507 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.237660 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.237837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.237990 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.238141 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.238304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.238456 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.238615 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.238767 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.238917 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.239067 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.239250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.239411 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.239563 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.239723 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.239882 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.240042 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.240208 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.240208 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.240506 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.240658 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.240821 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.240982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.241153 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.241316 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.241476 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.241637 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.241824 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.242000 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.242175 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.242331 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.242481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.242641 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.242800 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.242961 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.243131 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.243295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.243460 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.243612 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.243812 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.243969 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.244120 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.244278 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.244433 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.244593 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.244862 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.245029 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.245201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.245365 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.245521 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.245685 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.245879 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.246041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.246194 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.246353 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.246513 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.246677 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.246828 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.247016 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.247190 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.247351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.247503 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.247669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.247836 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.247989 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.248140 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.248291 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.248453 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.248614 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.248767 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.248919 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.249077 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.249241 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.249402 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.249553 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.249553 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.249911 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.250663 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.250837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.251081 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.251246 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.251407 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.251559 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.251710 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.251873 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.252034 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.252185 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.252336 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.252487 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.252638 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.252804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.252971 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.253123 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.253274 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.253437 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.253597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.253597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.253953 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.254106 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.254257 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.254407 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.254557 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.254762 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.255041 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.255203 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.255354 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.255505 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.255657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.255818 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.255972 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.256134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.256286 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.256444 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.256444 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.256762 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.256922 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.257074 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.257225 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.257375 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.257536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.257536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.257897 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.258070 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.258223 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.258380 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.258548 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.258701 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.258860 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.259013 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.259165 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.259316 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.259481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.259660 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.259814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.259975 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.260139 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.260307 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.260459 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.260610 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.260769 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.260929 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.261080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.261246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.261406 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.261565 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.261746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.261922 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.262075 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.262247 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.262400 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.262643 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.262825 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.262981 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.263140 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.263308 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.263461 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.263621 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.263773 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.263932 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.264094 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.264246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.264421 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.264589 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.264747 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.264934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.265225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.265385 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.265539 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.265714 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.266443 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.266599 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.266821 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.266991 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.267165 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.267318 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.267520 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.267688 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.267849 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.268001 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.268152 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.268303 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.268454 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.268658 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.268823 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.268989 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.269142 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.269315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.269468 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.269665 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.269856 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.269980 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.270103 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.270194 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.270281 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.270387 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.270475 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.270559 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.270657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.270742 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.270848 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.270935 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.271027 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.271117 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.271203 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.271287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.271379 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.271465 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.271465 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.271626 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.271718 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.271803 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.271897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.271981 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.272072 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.272165 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.272273 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.272374 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.272461 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.272545 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.272635 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.272729 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.272821 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.272919 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.273004 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.273088 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.273186 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.273278 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.273369 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:09:59.273468 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.273468 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.273468 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.273708 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.273978 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.274291 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.274607 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.274921 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.275334 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.275546 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.275864 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.276177 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.276494 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.276814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.277157 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.277480 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.277825 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.278149 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.278472 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.278785 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.280283 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.280283 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.280283 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.280283 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.280581 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.280654 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.280925 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.281387 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.281714 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.282054 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.282381 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.282695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.283020 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.283347 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.283665 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.283995 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.284309 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.284643 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.284990 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.285326 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.285657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.285996 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.286315 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.286626 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.286942 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.287265 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.287579 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.287888 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.288200 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.288515 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.288823 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.289134 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.289443 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.289777 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.290093 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.290400 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.290709 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.291016 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.291325 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.291634 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.291940 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.292252 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.292559 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.292869 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.293176 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.293484 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.293813 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.294151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.294487 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.294810 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.295137 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.295454 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.295783 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.296097 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.296430 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.296757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.297107 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.297423 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.297782 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.298099 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.298415 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.298730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.299045 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.299362 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.299815 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.300417 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.300747 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.301058 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.301386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.301707 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.302124 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.302445 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.302758 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.303092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.303406 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.303720 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.304035 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.304366 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.304668 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.305034 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.305301 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.305618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.305961 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.306287 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.306617 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.306947 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.307261 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.307591 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.307922 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.308270 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.308587 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.308932 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.309261 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.309580 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.309920 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.310229 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:09:59.310475 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:09:59.334050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO dbcounter [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] Registered counter for database nova_api Aug 30 01:09:59.354389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_db.sqlalchemy.engines [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:09:59.361982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writer thread running {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:09:59.373174 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO dbcounter [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] Registered counter for database nova_api Aug 30 01:09:59.395423 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_db.sqlalchemy.engines [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:09:59.402292 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writer thread running {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:09:59.420146 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.context [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4036817-1eea-418e-8a05-ed30a823773a(cell1) {{(pid=121233) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 01:09:59.424763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:59.425504 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:59.427459 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:59.427902 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:59.428360 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:59.430429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:59.432475 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO dbcounter [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] Registered counter for database nova_cell0 Aug 30 01:09:59.436723 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO dbcounter [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] Registered counter for database nova_cell1 Aug 30 01:09:59.445109 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_db.sqlalchemy.engines [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:09:59.448114 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_db.sqlalchemy.engines [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:09:59.456133 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writer thread running {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:09:59.456691 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writer thread running {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:09:59.460406 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.context [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d4036817-1eea-418e-8a05-ed30a823773a(cell1) {{(pid=121232) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 01:09:59.464491 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:59.464978 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:59.467155 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:59.467389 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:59.467838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:59.470445 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:59.472740 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO dbcounter [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] Registered counter for database nova_cell0 Aug 30 01:09:59.476871 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO dbcounter [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] Registered counter for database nova_cell1 Aug 30 01:09:59.485977 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_db.sqlalchemy.engines [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:09:59.487385 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_db.sqlalchemy.engines [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:09:59.494855 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writer thread running {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:09:59.497608 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writer thread running {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:09:59.607240 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO dbcounter [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] Registered counter for database nova_cell0 Aug 30 01:09:59.616364 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_db.sqlalchemy.engines [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:09:59.621428 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writer thread running {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:09:59.655787 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO dbcounter [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] Registered counter for database nova_cell0 Aug 30 01:09:59.662853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_db.sqlalchemy.engines [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:09:59.667670 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writer thread running {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:09:59.955015 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: WARNING keystonemiddleware.auth_token [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:09:59.962391 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: WARNING keystonemiddleware.auth_token [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:10:00.009344 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: WARNING keystonemiddleware.auth_token [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:10:00.016903 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: WARNING keystonemiddleware.auth_token [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:10:00.319501 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: WARNING keystonemiddleware.auth_token [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:10:00.325550 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: WARNING keystonemiddleware.auth_token [None req-65a8ff8e-cacd-4dee-9fd8-3af069a6d762 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:10:00.331492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f4ebfe9c0 pid: 121233 (default app) Aug 30 01:10:00.378010 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: WARNING keystonemiddleware.auth_token [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:10:00.384192 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: WARNING keystonemiddleware.auth_token [None req-d300d3f7-0292-4d3e-bef2-909074ee72d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:10:00.389677 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f4ebfe9c0 pid: 121232 (default app) Aug 30 01:10:37.741464 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=3 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:37.742428 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=3 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:37.743777 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=3 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:37.744727 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=3 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:39.163804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-dc6b4908-c602-4bfa-86c7-29aa26a55260 tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] Action: 'create', calling method: .version_select at 0x7fd71dfa7ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1126051108", "metadata": {"Type": "work"}}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:41.929457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-dc6b4908-c602-4bfa-86c7-29aa26a55260 tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.203970 Aug 30 01:10:41.930247 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Aug 30 01:10:37 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4206 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 01:10:41.958399 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:41.964373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:41.964373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:41.964373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:10:42.300239 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-09bf0580-fe0d-4ab9-8309-6ecaebc7ea06 tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] Calling method '.version_select at 0x7fd71dfa3a60>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:42.837960 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-09bf0580-fe0d-4ab9-8309-6ecaebc7ea06 tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/c9b84650-0a84-456c-bf74-d45e52c4e25c" status: 200 len: 353 microversion: 2.1 time: 0.895470 Aug 30 01:10:42.838652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 1/2] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 30 01:10:41 2022] GET /compute/v2.1/os-volumes/c9b84650-0a84-456c-bf74-d45e52c4e25c => generated 353 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:10:43.852961 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ee4354e9-ac56-4139-baf9-abf2f553ee4b tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] Calling method '.version_select at 0x7fd71de2ad30>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:44.372224 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ee4354e9-ac56-4139-baf9-abf2f553ee4b tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/c9b84650-0a84-456c-bf74-d45e52c4e25c" status: 200 len: 354 microversion: 2.1 time: 0.523228 Aug 30 01:10:44.373756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 30 01:10:43 2022] GET /compute/v2.1/os-volumes/c9b84650-0a84-456c-bf74-d45e52c4e25c => generated 354 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:10:44.397085 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4ec00fa9-01a8-4541-99a4-6744d9b08fdb tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] Calling method '.version_select at 0x7fd71de67f70>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:44.511486 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4ec00fa9-01a8-4541-99a4-6744d9b08fdb tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/c9b84650-0a84-456c-bf74-d45e52c4e25c" status: 200 len: 354 microversion: 2.1 time: 0.123092 Aug 30 01:10:44.512821 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 30 01:10:44 2022] GET /compute/v2.1/os-volumes/c9b84650-0a84-456c-bf74-d45e52c4e25c => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:10:44.535672 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-aa2842dc-5df8-451e-a08a-113db7e5d68e tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] Calling method '.version_select at 0x7fd71de40430>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:44.826376 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-aa2842dc-5df8-451e-a08a-113db7e5d68e tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/c9b84650-0a84-456c-bf74-d45e52c4e25c" status: 202 len: 0 microversion: 2.1 time: 0.295933 Aug 30 01:10:44.827228 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 3/5] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 30 01:10:44 2022] DELETE /compute/v2.1/os-volumes/c9b84650-0a84-456c-bf74-d45e52c4e25c => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:10:44.840289 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9bcecb01-a61f-4a18-873f-0a30658c543d tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] Calling method '.version_select at 0x7fd71de25430>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:45.008007 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9bcecb01-a61f-4a18-873f-0a30658c543d tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/c9b84650-0a84-456c-bf74-d45e52c4e25c" status: 200 len: 353 microversion: 2.1 time: 0.174012 Aug 30 01:10:45.009269 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 3/6] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 30 01:10:44 2022] GET /compute/v2.1/os-volumes/c9b84650-0a84-456c-bf74-d45e52c4e25c => generated 353 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:10:46.022065 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-1b4e053b-1a98-468b-91fa-6d01f7d6bd0c tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] Calling method '.version_select at 0x7fd71de40af0>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:10:46.084973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-1b4e053b-1a98-468b-91fa-6d01f7d6bd0c tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] HTTP exception thrown: Volume c9b84650-0a84-456c-bf74-d45e52c4e25c could not be found. Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-1b4e053b-1a98-468b-91fa-6d01f7d6bd0c tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] Request method failure captured: Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/os-volumes/c9b84650-0a84-456c-bf74-d45e52c4e25c HTTP/1.1 Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWON2PNcyBR0MEqykMFoU5Vj5D0vigvhtsD1WURA8Ejeds3ClB3S5VjaDIFEADe-jA3HvGyHSy2Or754YMyg-NmCV-gH6uDZusvFSnQs2rLp7kBknVM7T2oWuLoxRO8N3IsiQhP78df-elJBaG_gFOnKwdUa3bCCYhI6EZSWOva-7B8 Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 9aaae18da02e4446a8898dc57ee662ec Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-VolumesGetTestJSON-2140082916 Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:10:46.089642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:10:46.090850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9aaae18da02e4446a8898dc57ee662ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9aaae18da02e4446a8898dc57ee662ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9aaae18da02e4446a8898dc57ee662ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9aaae18da02e4446a8898dc57ee662ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:10:46.090850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-VolumesGetTestJSON-2140082916 Aug 30 01:10:46.090850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 9aaae18da02e4446a8898dc57ee662ec Aug 30 01:10:46.090850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-VolumesGetTestJSON-2140082916 Aug 30 01:10:46.090850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-VolumesGetTestJSON-2140082916-project Aug 30 01:10:46.090850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:10:46.090850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:10:46.090850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 88d31346e1104a2a878cc87e30d68fd6 Aug 30 01:10:46.090850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-VolumesGetTestJSON-2140082916-project Aug 30 01:10:46.090850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: Aug 30 01:10:46.090850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Volume c9b84650-0a84-456c-bf74-d45e52c4e25c could not be found. Aug 30 01:10:46.090850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': 'c9b84650-0a84-456c-bf74-d45e52c4e25c'} Aug 30 01:10:46.090850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c9b84650-0a84-456c-bf74-d45e52c4e25c could not be found. (HTTP 404) (Request-ID: req-6b21cecb-8c28-41ef-ace6-89c6f523591a) Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:46.091753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:10:46.093112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c9b84650-0a84-456c-bf74-d45e52c4e25c could not be found. Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 01:10:46.094066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:10:46.095021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c9b84650-0a84-456c-bf74-d45e52c4e25c could not be found. Aug 30 01:10:46.095021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:10:46.095021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:10:46.095021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:10:46.095021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:10:46.095021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:10:46.095021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:10:46.095021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:10:46.095021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:10:46.095021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c9b84650-0a84-456c-bf74-d45e52c4e25c could not be found. Aug 30 01:10:46.095021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:10:46.097626 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-1b4e053b-1a98-468b-91fa-6d01f7d6bd0c tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] Returning 404 to user: Volume c9b84650-0a84-456c-bf74-d45e52c4e25c could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:10:46.098821 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-1b4e053b-1a98-468b-91fa-6d01f7d6bd0c tempest-VolumesGetTestJSON-2140082916 tempest-VolumesGetTestJSON-2140082916-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/c9b84650-0a84-456c-bf74-d45e52c4e25c" status: 404 len: 109 microversion: 2.1 time: 0.081483 Aug 30 01:10:46.100833 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 30 01:10:46 2022] GET /compute/v2.1/os-volumes/c9b84650-0a84-456c-bf74-d45e52c4e25c => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:10:52.620509 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-52cff47d-56ec-4dd5-9412-a4cd20c84c7e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Action: 'create', calling method: .version_select at 0x7fd71de67ee0>, body: {"keypair": {"name": "tempest-keypair-1276074389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmsIb7LyL5rlEeWJJHKwLa473+aEHVcsKKljnA9vFrprSqelC2QJChn1yRi10/EvEKdWbtGhuVIVSOF0cr5wRMK8Ah2qWRZ7sv7VzqQSym6lx89aFOFE6AVYOoLeTfrJg=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:52.751344 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-52cff47d-56ec-4dd5-9412-a4cd20c84c7e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Getting quotas for project 13862ab3a9504644853a8c48c3f69b4c. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:10:52.769339 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-52cff47d-56ec-4dd5-9412-a4cd20c84c7e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Getting quotas for user 90486e175bb2411b9f2adedf6e3ecac6 and project 13862ab3a9504644853a8c48c3f69b4c. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:10:52.978973 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-52cff47d-56ec-4dd5-9412-a4cd20c84c7e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.705363 Aug 30 01:10:52.979844 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 4/8] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 30 01:10:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:10:55.307740 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1350137537", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:55.557609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.network.neutron [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] validate_networks() for [('ac8d987a-03fa-42da-829e-4cee4dd670a9', None, None, None, None, None)] {{(pid=121233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:10:57.001146 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f90166b7-5ecf-49bd-a81d-d5580167d2c4 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Action: 'create', calling method: .version_select at 0x7fd71dd8ca60>, body: {"keypair": {"name": "tempest-keypair-521380224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPijvbPZ0Mj6NuzEELAQkE0bxIIGkjW2pvdkOPl9G2gIvXDrNwoPoFaRvBlE38fIcGL+KZoFfXy2y6oXJ9IBGIVFCgC1LOXSTcLbKY+DbHayuXLRD+S+fB+9JGLfdexikw=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:57.059267 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-f90166b7-5ecf-49bd-a81d-d5580167d2c4 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Getting quotas for project 11c8f48af7394a75ab6013ca066751a7. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:10:57.074379 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-f90166b7-5ecf-49bd-a81d-d5580167d2c4 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Getting quotas for user 942d175e7e2742728e66fea84c851038 and project 11c8f48af7394a75ab6013ca066751a7. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:10:57.321644 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f90166b7-5ecf-49bd-a81d-d5580167d2c4 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.295839 Aug 30 01:10:57.323092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 5/9] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 30 01:10:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:10:59.052044 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Flavor limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:10:59.053100 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Image limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:10:59.053798 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Flavor pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:10:59.054375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Image pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:10:59.065478 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:10:59.070750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:59.070750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:59.071378 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:59.072206 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:10:59.072758 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:10:59.073300 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:10:59.144473 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Getting quotas for project 9f0605a8a2fe48e49a410127b5f3b32c. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:10:59.162818 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Getting quotas for user 76ea3ed3bb2b412093004c7e0f49c7ce and project 9f0605a8a2fe48e49a410127b5f3b32c. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:10:59.198822 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Going to run 1 instances... {{(pid=121233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:10:59.202298 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:10:59.442773 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6115faf7-d279-44cb-8ece-1679c1c04f6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.457297 Aug 30 01:10:59.461337 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 5/10] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:10:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 4477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:10:59.472785 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1270569896", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37938639-da56-43d1-ac7c-a949da52ba53"}], "security_groups": [{"name": "tempest-securitygroup--1641004129"}], "key_name": "tempest-keypair-1276074389", "user_data": "}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:59.703228 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.network.neutron [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] validate_networks() for [('37938639-da56-43d1-ac7c-a949da52ba53', None, None, None, None, None)] {{(pid=121233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:10:59.886451 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6cea5ba0-acae-421e-a94e-df7b34b01e88 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Action: 'create', calling method: .version_select at 0x7fd71ddc64c0>, body: {"keypair": {"name": "tempest-keypair-1085343442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIB8mGjJfYOIOlEYnbrD9DBMnqcGVjZXvthMFu93FadsY9mBc4PtskRu9chhO3uCOzeZBWjbMeFLtGIovmKh+PVGLMrAWPAjElbwh4aQ+a7MwQhJ9DXEBAMGfvTm+dUhQ=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:10:59.976868 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-6cea5ba0-acae-421e-a94e-df7b34b01e88 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Getting quotas for project 742c089b0dea4b1f89efd31f48f9ffc5. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:11:00.003636 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-6cea5ba0-acae-421e-a94e-df7b34b01e88 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Getting quotas for user 2ffe5c7cb44f476e913d64003105002c and project 742c089b0dea4b1f89efd31f48f9ffc5. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:11:00.145559 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6cea5ba0-acae-421e-a94e-df7b34b01e88 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.013110 Aug 30 01:11:00.146295 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 6/11] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Aug 30 01:10:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1015 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 30 01:11:00.151917 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-46fae128-426e-4036-9402-b80ef25c95f6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:00.154668 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-46fae128-426e-4036-9402-b80ef25c95f6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:00.354195 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-46fae128-426e-4036-9402-b80ef25c95f6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:00.379985 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-46fae128-426e-4036-9402-b80ef25c95f6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1222 microversion: 2.1 time: 0.232271 Aug 30 01:11:00.402027 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 7/12] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:00 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1222 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:01.090672 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-30879393", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452", "networks": [{"uuid": "a4ad0ac8-1d42-4e74-88e7-302cf181b538"}]}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:01.357467 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] validate_networks() for [('a4ad0ac8-1d42-4e74-88e7-302cf181b538', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:11:01.439878 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Flavor limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:11:01.440501 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Image limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:11:01.440784 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Flavor pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:11:01.441712 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Image pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:11:01.442179 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:11:01.479845 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:01.480684 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:01.487034 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:01.489436 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:01.489973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:01.493074 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:01.535423 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Getting quotas for project 13862ab3a9504644853a8c48c3f69b4c. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:11:01.551110 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Getting quotas for user 90486e175bb2411b9f2adedf6e3ecac6 and project 13862ab3a9504644853a8c48c3f69b4c. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:11:01.588396 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Going to run 1 instances... {{(pid=121233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:11:01.598361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:11:01.913797 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2d832f66-6770-420f-af1f-f4a3caf52f9b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.450800 Aug 30 01:11:01.924560 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 6/13] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:10:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 2462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:11:01.948964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-256052535", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:02.144093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.network.neutron [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] validate_networks() for [('ac8d987a-03fa-42da-829e-4cee4dd670a9', None, None, None, None, None)] {{(pid=121233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:11:03.054862 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Flavor limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:11:03.055575 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Image limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:11:03.061789 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Flavor pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:11:03.061789 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Image pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:11:03.061789 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:11:03.070435 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:03.071463 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:03.072160 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:03.073769 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:03.074479 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:03.075872 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:03.097712 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Getting quotas for project 9f0605a8a2fe48e49a410127b5f3b32c. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:11:03.103218 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Getting quotas for user 76ea3ed3bb2b412093004c7e0f49c7ce and project 9f0605a8a2fe48e49a410127b5f3b32c. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:11:03.138485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Going to run 1 instances... {{(pid=121233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:11:03.145474 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:11:03.519764 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6a114df6-9ec5-4a9f-ba77-73fc594affab tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.591095 Aug 30 01:11:03.523925 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 7/14] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:11:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:11:03.543744 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-48618ab6-40de-4d01-b749-cc8453f1ee28 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:03.546814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-48618ab6-40de-4d01-b749-cc8453f1ee28 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:03.977142 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:11:03.978902 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:11:03.979778 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:11:03.980332 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:11:03.981385 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:11:04.015870 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-48618ab6-40de-4d01-b749-cc8453f1ee28 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:04.026905 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:04.027511 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:04.031557 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:04.032402 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:04.033000 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:04.033312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:04.055627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-48618ab6-40de-4d01-b749-cc8453f1ee28 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1238 microversion: 2.1 time: 0.526248 Aug 30 01:11:04.078074 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 8/15] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:03 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1238 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:04.090348 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f33e9a1c-6982-404c-ae7e-40f61493e246 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:04.090348 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f33e9a1c-6982-404c-ae7e-40f61493e246 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:04.219035 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Getting quotas for project 4f082e13ad014501b7a781167ddb2ed8. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:11:04.228013 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Getting quotas for user 13848c47ddd9441282bec982cccc8b91 and project 4f082e13ad014501b7a781167ddb2ed8. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:11:04.254605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:11:04.257465 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:11:04.501511 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-62a0483f-5fe5-4151-bd45-9c8a52d0c85e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.115808 Aug 30 01:11:04.512525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 8/16] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:11:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 4131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:11:04.528468 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-250573945", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "281ceb28-999a-45ac-8b94-e3a5aba703ca"}], "security_groups": [{"name": "tempest-securitygroup--670078372"}], "key_name": "tempest-keypair-521380224", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:04.757096 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f33e9a1c-6982-404c-ae7e-40f61493e246 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:04.765353 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f33e9a1c-6982-404c-ae7e-40f61493e246 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1221 microversion: 2.1 time: 0.685801 Aug 30 01:11:04.784978 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 9/17] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:04 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1221 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:04.819468 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c6fbd100-65bc-4e65-815d-5ce71f8517fc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:04.833443 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c6fbd100-65bc-4e65-815d-5ce71f8517fc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:05.008858 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] validate_networks() for [('281ceb28-999a-45ac-8b94-e3a5aba703ca', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:11:05.157475 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c6fbd100-65bc-4e65-815d-5ce71f8517fc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:05.191668 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c6fbd100-65bc-4e65-815d-5ce71f8517fc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1213 microversion: 2.1 time: 0.404359 Aug 30 01:11:05.196900 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 10/18] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:04 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1213 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:05.218185 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4a411262-93a2-42dd-94ed-5a6381bd2841 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:05.218414 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4a411262-93a2-42dd-94ed-5a6381bd2841 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:05.857916 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4a411262-93a2-42dd-94ed-5a6381bd2841 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:05.867637 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4a411262-93a2-42dd-94ed-5a6381bd2841 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1238 microversion: 2.1 time: 0.668407 Aug 30 01:11:05.875719 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 11/19] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:05 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1238 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:05.881577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2745a216-89d8-4f35-92f5-3182d344984e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:05.882521 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2745a216-89d8-4f35-92f5-3182d344984e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:05.933814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2745a216-89d8-4f35-92f5-3182d344984e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:05.938434 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2745a216-89d8-4f35-92f5-3182d344984e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:05.939107 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2745a216-89d8-4f35-92f5-3182d344984e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:05.940206 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2745a216-89d8-4f35-92f5-3182d344984e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:05.943338 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2745a216-89d8-4f35-92f5-3182d344984e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:05.946166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2745a216-89d8-4f35-92f5-3182d344984e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:05.987350 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:11:05.987691 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:11:05.988165 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:11:05.990136 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:11:05.990737 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:11:06.007611 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:06.008079 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:06.008500 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:06.011747 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:06.014395 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:06.015015 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:06.058054 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Getting quotas for project 11c8f48af7394a75ab6013ca066751a7. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:11:06.066945 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Getting quotas for user 942d175e7e2742728e66fea84c851038 and project 11c8f48af7394a75ab6013ca066751a7. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:11:06.089020 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:11:06.121575 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:11:06.304448 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2745a216-89d8-4f35-92f5-3182d344984e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:06.322466 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2745a216-89d8-4f35-92f5-3182d344984e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1225 microversion: 2.1 time: 0.444930 Aug 30 01:11:06.323606 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 12/20] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:05 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1225 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:06.331547 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-32efa618-e101-4c2b-a061-8fe17c75fb88 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:06.332292 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-32efa618-e101-4c2b-a061-8fe17c75fb88 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:06.413417 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ddeb36fb-78c2-4d5b-8125-cd36343d0d88 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.899216 Aug 30 01:11:06.414208 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 9/21] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:11:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:11:06.435338 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-37909a35-4a6d-46bf-9041-6dd5c4156b87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:06.435338 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-37909a35-4a6d-46bf-9041-6dd5c4156b87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:06.512101 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-32efa618-e101-4c2b-a061-8fe17c75fb88 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:06.523741 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-32efa618-e101-4c2b-a061-8fe17c75fb88 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1213 microversion: 2.1 time: 0.197847 Aug 30 01:11:06.542013 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 13/22] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:06 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1213 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:06.653160 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-37909a35-4a6d-46bf-9041-6dd5c4156b87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:06.668727 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-37909a35-4a6d-46bf-9041-6dd5c4156b87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1240 microversion: 2.1 time: 0.245381 Aug 30 01:11:06.681871 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 10/23] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:06 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1240 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:06.890917 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-fb590d3b-afa1-425f-8e46-78e8db0a8575 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:06.899881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-fb590d3b-afa1-425f-8e46-78e8db0a8575 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:06.932666 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fb590d3b-afa1-425f-8e46-78e8db0a8575 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:06.938520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fb590d3b-afa1-425f-8e46-78e8db0a8575 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:06.939213 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fb590d3b-afa1-425f-8e46-78e8db0a8575 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:06.940408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fb590d3b-afa1-425f-8e46-78e8db0a8575 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:06.941871 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fb590d3b-afa1-425f-8e46-78e8db0a8575 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:06.943142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fb590d3b-afa1-425f-8e46-78e8db0a8575 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:07.084602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-fb590d3b-afa1-425f-8e46-78e8db0a8575 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:07.097250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-fb590d3b-afa1-425f-8e46-78e8db0a8575 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1290 microversion: 2.1 time: 0.211344 Aug 30 01:11:07.099644 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 14/24] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:06 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1290 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:07.269524 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1101257630", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6de2f2e9-71f3-49c9-a223-f1fb974d9e7f"}], "security_groups": [{"name": "tempest-securitygroup--639536143"}], "key_name": "tempest-keypair-1085343442", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:07.347412 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-69f24492-c743-4307-8996-982ae0b153a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:07.350254 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-69f24492-c743-4307-8996-982ae0b153a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:07.368660 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69f24492-c743-4307-8996-982ae0b153a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:07.369323 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69f24492-c743-4307-8996-982ae0b153a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:07.369908 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69f24492-c743-4307-8996-982ae0b153a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:07.370879 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69f24492-c743-4307-8996-982ae0b153a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:07.371431 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69f24492-c743-4307-8996-982ae0b153a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:07.371962 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69f24492-c743-4307-8996-982ae0b153a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:07.404876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] validate_networks() for [('6de2f2e9-71f3-49c9-a223-f1fb974d9e7f', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:11:07.444446 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-69f24492-c743-4307-8996-982ae0b153a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:07.453060 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-69f24492-c743-4307-8996-982ae0b153a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1217 microversion: 2.1 time: 0.112469 Aug 30 01:11:07.454241 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 15/25] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:07 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1217 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:07.550581 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-10283e0b-95fe-4c7e-a8c2-3d66da0d02e8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:07.551415 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-10283e0b-95fe-4c7e-a8c2-3d66da0d02e8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:07.558289 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10283e0b-95fe-4c7e-a8c2-3d66da0d02e8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:07.566712 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10283e0b-95fe-4c7e-a8c2-3d66da0d02e8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:07.566712 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10283e0b-95fe-4c7e-a8c2-3d66da0d02e8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:07.566712 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10283e0b-95fe-4c7e-a8c2-3d66da0d02e8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:07.566712 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10283e0b-95fe-4c7e-a8c2-3d66da0d02e8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:07.567199 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10283e0b-95fe-4c7e-a8c2-3d66da0d02e8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:07.640129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-10283e0b-95fe-4c7e-a8c2-3d66da0d02e8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:07.650854 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-10283e0b-95fe-4c7e-a8c2-3d66da0d02e8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1217 microversion: 2.1 time: 0.105970 Aug 30 01:11:07.652029 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 16/26] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:07 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:07.695394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0e172a84-3e5c-4a47-90dc-a5552231b94f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:07.696494 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0e172a84-3e5c-4a47-90dc-a5552231b94f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:07.897447 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0e172a84-3e5c-4a47-90dc-a5552231b94f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:07.911121 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0e172a84-3e5c-4a47-90dc-a5552231b94f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1240 microversion: 2.1 time: 0.218017 Aug 30 01:11:07.935254 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 17/27] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:07 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1240 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:08.014521 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:11:08.015343 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:11:08.015974 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:11:08.016516 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:11:08.017268 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:11:08.028830 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:08.030145 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:08.030804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:08.031704 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:08.032345 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:08.032914 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:08.054361 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Getting quotas for project 742c089b0dea4b1f89efd31f48f9ffc5. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:11:08.061288 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Getting quotas for user 2ffe5c7cb44f476e913d64003105002c and project 742c089b0dea4b1f89efd31f48f9ffc5. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:11:08.073223 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:11:08.075730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:11:08.133816 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-8885a7ad-cfbb-4855-809c-122ad1958588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:08.135666 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-8885a7ad-cfbb-4855-809c-122ad1958588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:08.149979 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8885a7ad-cfbb-4855-809c-122ad1958588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:08.149979 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8885a7ad-cfbb-4855-809c-122ad1958588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:08.149979 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8885a7ad-cfbb-4855-809c-122ad1958588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:08.149979 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8885a7ad-cfbb-4855-809c-122ad1958588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:08.150373 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8885a7ad-cfbb-4855-809c-122ad1958588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:08.150373 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8885a7ad-cfbb-4855-809c-122ad1958588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:08.267066 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6a32a6cc-d603-4271-aa53-3fdb21e90480 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.999768 Aug 30 01:11:08.270062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 11/28] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Aug 30 01:11:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 01:11:08.287161 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4904918a-cd4d-405a-a804-6d8330686573 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:08.288767 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4904918a-cd4d-405a-a804-6d8330686573 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:08.313370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-8885a7ad-cfbb-4855-809c-122ad1958588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:08.327566 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:08.331654 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-8885a7ad-cfbb-4855-809c-122ad1958588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1290 microversion: 2.1 time: 0.201346 Aug 30 01:11:08.333237 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 18/29] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:08 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1290 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:08.385189 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4904918a-cd4d-405a-a804-6d8330686573 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:08.401230 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4904918a-cd4d-405a-a804-6d8330686573 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:08.402822 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4904918a-cd4d-405a-a804-6d8330686573 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:08.403977 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4904918a-cd4d-405a-a804-6d8330686573 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1282 microversion: 2.20 time: 0.128791 Aug 30 01:11:08.405483 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 12/30] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:08 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1282 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:08.478413 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-dd600fbc-460f-4e09-a8bf-f894ddd2388e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:08.479041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-dd600fbc-460f-4e09-a8bf-f894ddd2388e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:08.486360 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dd600fbc-460f-4e09-a8bf-f894ddd2388e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:08.486857 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dd600fbc-460f-4e09-a8bf-f894ddd2388e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:08.487373 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dd600fbc-460f-4e09-a8bf-f894ddd2388e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:08.487979 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dd600fbc-460f-4e09-a8bf-f894ddd2388e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:08.488605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dd600fbc-460f-4e09-a8bf-f894ddd2388e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:08.489211 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dd600fbc-460f-4e09-a8bf-f894ddd2388e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:08.588379 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-dd600fbc-460f-4e09-a8bf-f894ddd2388e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:08.597662 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-dd600fbc-460f-4e09-a8bf-f894ddd2388e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1217 microversion: 2.1 time: 0.124841 Aug 30 01:11:08.611347 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 19/31] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:08 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1217 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:08.672636 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1aaa9501-e338-4b40-8df5-de3db761237c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:08.673400 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1aaa9501-e338-4b40-8df5-de3db761237c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:08.679768 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1aaa9501-e338-4b40-8df5-de3db761237c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:08.680290 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1aaa9501-e338-4b40-8df5-de3db761237c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:08.680957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1aaa9501-e338-4b40-8df5-de3db761237c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:08.681689 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1aaa9501-e338-4b40-8df5-de3db761237c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:08.682427 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1aaa9501-e338-4b40-8df5-de3db761237c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:08.682860 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1aaa9501-e338-4b40-8df5-de3db761237c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:08.836495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1aaa9501-e338-4b40-8df5-de3db761237c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:08.851098 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1aaa9501-e338-4b40-8df5-de3db761237c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1217 microversion: 2.1 time: 0.182702 Aug 30 01:11:08.851883 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 13/32] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:08 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:08.954586 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a20562cf-074d-4ddc-9839-1f26039e57f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:08.955215 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a20562cf-074d-4ddc-9839-1f26039e57f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:08.961762 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a20562cf-074d-4ddc-9839-1f26039e57f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:08.962939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a20562cf-074d-4ddc-9839-1f26039e57f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:08.962939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a20562cf-074d-4ddc-9839-1f26039e57f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:08.963583 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a20562cf-074d-4ddc-9839-1f26039e57f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:08.964104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a20562cf-074d-4ddc-9839-1f26039e57f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:08.964700 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a20562cf-074d-4ddc-9839-1f26039e57f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:09.028053 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a20562cf-074d-4ddc-9839-1f26039e57f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:09.036226 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a20562cf-074d-4ddc-9839-1f26039e57f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1244 microversion: 2.1 time: 0.086438 Aug 30 01:11:09.037089 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 20/33] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:08 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:09.355224 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-be6aad4f-67e6-4a1e-9dbd-2ade3f746047 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:09.355755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-be6aad4f-67e6-4a1e-9dbd-2ade3f746047 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:09.366753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-be6aad4f-67e6-4a1e-9dbd-2ade3f746047 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:09.367263 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-be6aad4f-67e6-4a1e-9dbd-2ade3f746047 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:09.368251 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-be6aad4f-67e6-4a1e-9dbd-2ade3f746047 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:09.368709 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-be6aad4f-67e6-4a1e-9dbd-2ade3f746047 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:09.369286 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-be6aad4f-67e6-4a1e-9dbd-2ade3f746047 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:09.369744 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-be6aad4f-67e6-4a1e-9dbd-2ade3f746047 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:09.431459 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-18072ad7-cfc9-4919-9352-d6175e8621be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:09.432289 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-18072ad7-cfc9-4919-9352-d6175e8621be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:09.463799 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-be6aad4f-67e6-4a1e-9dbd-2ade3f746047 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:09.467223 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-be6aad4f-67e6-4a1e-9dbd-2ade3f746047 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1290 microversion: 2.1 time: 0.116229 Aug 30 01:11:09.467979 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 14/34] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:09 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1290 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:09.492722 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-18072ad7-cfc9-4919-9352-d6175e8621be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:09.500944 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-18072ad7-cfc9-4919-9352-d6175e8621be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:09.502516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-18072ad7-cfc9-4919-9352-d6175e8621be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:09.503617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-18072ad7-cfc9-4919-9352-d6175e8621be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1282 microversion: 2.20 time: 0.076261 Aug 30 01:11:09.504174 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 21/35] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:09 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1282 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:11:09.619148 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c73bdbc1-9de9-49fe-8ab3-f7b7ecaac955 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:09.620452 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c73bdbc1-9de9-49fe-8ab3-f7b7ecaac955 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:09.627797 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c73bdbc1-9de9-49fe-8ab3-f7b7ecaac955 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:09.628470 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c73bdbc1-9de9-49fe-8ab3-f7b7ecaac955 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:09.629153 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c73bdbc1-9de9-49fe-8ab3-f7b7ecaac955 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:09.629943 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c73bdbc1-9de9-49fe-8ab3-f7b7ecaac955 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:09.630497 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c73bdbc1-9de9-49fe-8ab3-f7b7ecaac955 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:09.630875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c73bdbc1-9de9-49fe-8ab3-f7b7ecaac955 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:09.753766 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c73bdbc1-9de9-49fe-8ab3-f7b7ecaac955 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:09.762184 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c73bdbc1-9de9-49fe-8ab3-f7b7ecaac955 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1217 microversion: 2.1 time: 0.146925 Aug 30 01:11:09.764129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 15/36] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:09 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:09.882035 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-7ad6f420-1c90-4cbc-a435-0d16a5a97da7 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:09.883618 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-7ad6f420-1c90-4cbc-a435-0d16a5a97da7 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:09.901810 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7ad6f420-1c90-4cbc-a435-0d16a5a97da7 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:09.902608 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7ad6f420-1c90-4cbc-a435-0d16a5a97da7 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:09.903223 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7ad6f420-1c90-4cbc-a435-0d16a5a97da7 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:09.904105 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7ad6f420-1c90-4cbc-a435-0d16a5a97da7 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:09.907791 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7ad6f420-1c90-4cbc-a435-0d16a5a97da7 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:09.909055 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7ad6f420-1c90-4cbc-a435-0d16a5a97da7 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:10.038747 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7ad6f420-1c90-4cbc-a435-0d16a5a97da7 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:10.057903 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e2fad343-1bef-4a9d-96ef-4764c930bf07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:10.058302 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-7ad6f420-1c90-4cbc-a435-0d16a5a97da7 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1209 microversion: 2.1 time: 0.189932 Aug 30 01:11:10.060904 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e2fad343-1bef-4a9d-96ef-4764c930bf07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:10.068616 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2fad343-1bef-4a9d-96ef-4764c930bf07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:10.069364 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2fad343-1bef-4a9d-96ef-4764c930bf07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:10.070094 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2fad343-1bef-4a9d-96ef-4764c930bf07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:10.070994 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2fad343-1bef-4a9d-96ef-4764c930bf07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:10.074140 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 22/37] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:09 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1209 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:10.079002 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2fad343-1bef-4a9d-96ef-4764c930bf07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:10.079002 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2fad343-1bef-4a9d-96ef-4764c930bf07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:10.225853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e2fad343-1bef-4a9d-96ef-4764c930bf07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:10.234671 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e2fad343-1bef-4a9d-96ef-4764c930bf07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1244 microversion: 2.1 time: 0.181391 Aug 30 01:11:10.239033 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 16/38] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:10 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1244 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:10.495553 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-62e3063e-034d-4832-9f8b-4e0f09becf7a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:10.497003 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-62e3063e-034d-4832-9f8b-4e0f09becf7a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:10.504849 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-62e3063e-034d-4832-9f8b-4e0f09becf7a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:10.505443 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-62e3063e-034d-4832-9f8b-4e0f09becf7a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:10.506027 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-62e3063e-034d-4832-9f8b-4e0f09becf7a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:10.507036 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-62e3063e-034d-4832-9f8b-4e0f09becf7a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:10.507589 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-62e3063e-034d-4832-9f8b-4e0f09becf7a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:10.508167 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-62e3063e-034d-4832-9f8b-4e0f09becf7a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:10.526954 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-139408c9-c0d3-4407-b563-b4400a342b33 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:10.527762 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-139408c9-c0d3-4407-b563-b4400a342b33 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:10.551654 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-139408c9-c0d3-4407-b563-b4400a342b33 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:10.551654 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-139408c9-c0d3-4407-b563-b4400a342b33 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:10.551654 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-139408c9-c0d3-4407-b563-b4400a342b33 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:10.551654 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-139408c9-c0d3-4407-b563-b4400a342b33 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:10.552145 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-139408c9-c0d3-4407-b563-b4400a342b33 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:10.552145 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-139408c9-c0d3-4407-b563-b4400a342b33 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:10.665528 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-62e3063e-034d-4832-9f8b-4e0f09becf7a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:10.676629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-62e3063e-034d-4832-9f8b-4e0f09becf7a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1290 microversion: 2.1 time: 0.184915 Aug 30 01:11:10.678350 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 23/39] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:10 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1290 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:10.780679 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-139408c9-c0d3-4407-b563-b4400a342b33 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:10.790658 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-bdc107dd-a630-45a8-b1c8-5584c222717a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:10.797516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-bdc107dd-a630-45a8-b1c8-5584c222717a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:10.797863 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-139408c9-c0d3-4407-b563-b4400a342b33 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:10.807206 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-139408c9-c0d3-4407-b563-b4400a342b33 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:10.815006 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-139408c9-c0d3-4407-b563-b4400a342b33 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1278 microversion: 2.20 time: 0.286517 Aug 30 01:11:10.815825 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 17/40] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:10 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1278 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:10.821308 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bdc107dd-a630-45a8-b1c8-5584c222717a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:10.823207 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bdc107dd-a630-45a8-b1c8-5584c222717a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:10.823658 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bdc107dd-a630-45a8-b1c8-5584c222717a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:10.825507 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bdc107dd-a630-45a8-b1c8-5584c222717a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:10.829207 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bdc107dd-a630-45a8-b1c8-5584c222717a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:10.830817 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bdc107dd-a630-45a8-b1c8-5584c222717a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:11.097562 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-23369aa0-be92-4254-b07d-cc1e8f9baffc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:11.098228 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-23369aa0-be92-4254-b07d-cc1e8f9baffc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:11.129657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23369aa0-be92-4254-b07d-cc1e8f9baffc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:11.132406 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23369aa0-be92-4254-b07d-cc1e8f9baffc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:11.136075 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23369aa0-be92-4254-b07d-cc1e8f9baffc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:11.136946 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23369aa0-be92-4254-b07d-cc1e8f9baffc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:11.137438 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23369aa0-be92-4254-b07d-cc1e8f9baffc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:11.142332 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23369aa0-be92-4254-b07d-cc1e8f9baffc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:11.252075 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-bdc107dd-a630-45a8-b1c8-5584c222717a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:11.256440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-23369aa0-be92-4254-b07d-cc1e8f9baffc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:11.269805 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-bdc107dd-a630-45a8-b1c8-5584c222717a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1273 microversion: 2.1 time: 0.480363 Aug 30 01:11:11.270598 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 24/41] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:10 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1273 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:11.274293 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-23369aa0-be92-4254-b07d-cc1e8f9baffc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1265 microversion: 2.1 time: 0.191001 Aug 30 01:11:11.290540 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 18/42] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:11 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:11.312561 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-038bd4cb-1e1e-4057-bca5-1215f4d0be68 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:11.312561 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-038bd4cb-1e1e-4057-bca5-1215f4d0be68 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:11.322295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:11.333357 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-038bd4cb-1e1e-4057-bca5-1215f4d0be68 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:11.336404 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-038bd4cb-1e1e-4057-bca5-1215f4d0be68 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:11.336757 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-038bd4cb-1e1e-4057-bca5-1215f4d0be68 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:11.337534 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-038bd4cb-1e1e-4057-bca5-1215f4d0be68 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:11.338046 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-038bd4cb-1e1e-4057-bca5-1215f4d0be68 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:11.374890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-038bd4cb-1e1e-4057-bca5-1215f4d0be68 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:11.444235 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-038bd4cb-1e1e-4057-bca5-1215f4d0be68 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:11.452466 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-038bd4cb-1e1e-4057-bca5-1215f4d0be68 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1292 microversion: 2.1 time: 0.167855 Aug 30 01:11:11.453062 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 25/43] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:11 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1292 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:11.699813 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-60ba0ee0-f38a-47b1-b33f-bb72b2a0ad83 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:11.700605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-60ba0ee0-f38a-47b1-b33f-bb72b2a0ad83 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:11.715118 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60ba0ee0-f38a-47b1-b33f-bb72b2a0ad83 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:11.716148 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60ba0ee0-f38a-47b1-b33f-bb72b2a0ad83 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:11.720168 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60ba0ee0-f38a-47b1-b33f-bb72b2a0ad83 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:11.721044 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60ba0ee0-f38a-47b1-b33f-bb72b2a0ad83 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:11.722128 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60ba0ee0-f38a-47b1-b33f-bb72b2a0ad83 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:11.722927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60ba0ee0-f38a-47b1-b33f-bb72b2a0ad83 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:11.820490 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-60ba0ee0-f38a-47b1-b33f-bb72b2a0ad83 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:11.836791 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-60ba0ee0-f38a-47b1-b33f-bb72b2a0ad83 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1308 microversion: 2.1 time: 0.141251 Aug 30 01:11:11.845673 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 19/44] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:11 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1308 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:11.885253 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d16cd828-c37b-4156-820b-ffb84a16beed tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:11.889923 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d16cd828-c37b-4156-820b-ffb84a16beed tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:11.919026 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d16cd828-c37b-4156-820b-ffb84a16beed tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:11.923782 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d16cd828-c37b-4156-820b-ffb84a16beed tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:11.929915 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d16cd828-c37b-4156-820b-ffb84a16beed tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:11.932352 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d16cd828-c37b-4156-820b-ffb84a16beed tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:11.935603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d16cd828-c37b-4156-820b-ffb84a16beed tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:11.937047 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d16cd828-c37b-4156-820b-ffb84a16beed tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:12.297429 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c05454c6-46a2-40d6-99f3-dda6e70847f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:12.298219 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c05454c6-46a2-40d6-99f3-dda6e70847f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:12.314311 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c05454c6-46a2-40d6-99f3-dda6e70847f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:12.318603 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c05454c6-46a2-40d6-99f3-dda6e70847f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:12.322636 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c05454c6-46a2-40d6-99f3-dda6e70847f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:12.327934 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c05454c6-46a2-40d6-99f3-dda6e70847f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:12.330682 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c05454c6-46a2-40d6-99f3-dda6e70847f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:12.334015 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c05454c6-46a2-40d6-99f3-dda6e70847f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:12.395894 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d16cd828-c37b-4156-820b-ffb84a16beed tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:12.425262 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d16cd828-c37b-4156-820b-ffb84a16beed tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:12.434931 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d16cd828-c37b-4156-820b-ffb84a16beed tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:12.440686 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d16cd828-c37b-4156-820b-ffb84a16beed tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1334 microversion: 2.20 time: 0.599304 Aug 30 01:11:12.450417 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 26/45] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:11 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1334 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:12.455099 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ac07303f-42d9-4519-ad66-15fe18019e0b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:12.457152 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ac07303f-42d9-4519-ad66-15fe18019e0b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:12.482742 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ac07303f-42d9-4519-ad66-15fe18019e0b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:12.485764 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ac07303f-42d9-4519-ad66-15fe18019e0b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:12.486436 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ac07303f-42d9-4519-ad66-15fe18019e0b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:12.488015 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ac07303f-42d9-4519-ad66-15fe18019e0b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:12.492316 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ac07303f-42d9-4519-ad66-15fe18019e0b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:12.492922 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ac07303f-42d9-4519-ad66-15fe18019e0b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:12.638406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ac07303f-42d9-4519-ad66-15fe18019e0b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:12.647800 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ac07303f-42d9-4519-ad66-15fe18019e0b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1273 microversion: 2.1 time: 0.203422 Aug 30 01:11:12.651294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 27/46] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:12 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:12.661559 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e750a0d1-1ad2-4199-980d-1fbad538fcc3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:12.662458 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e750a0d1-1ad2-4199-980d-1fbad538fcc3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:12.676335 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c05454c6-46a2-40d6-99f3-dda6e70847f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:12.681765 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e750a0d1-1ad2-4199-980d-1fbad538fcc3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:12.682598 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e750a0d1-1ad2-4199-980d-1fbad538fcc3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:12.683193 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e750a0d1-1ad2-4199-980d-1fbad538fcc3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:12.684082 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e750a0d1-1ad2-4199-980d-1fbad538fcc3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:12.684626 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e750a0d1-1ad2-4199-980d-1fbad538fcc3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:12.684959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e750a0d1-1ad2-4199-980d-1fbad538fcc3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:12.705051 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c05454c6-46a2-40d6-99f3-dda6e70847f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1281 microversion: 2.1 time: 0.417728 Aug 30 01:11:12.711635 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 20/47] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:12 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1281 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:12.870245 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4980eb4b-0f2c-4857-a81c-7fc06c827375 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:12.871332 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4980eb4b-0f2c-4857-a81c-7fc06c827375 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:12.890350 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4980eb4b-0f2c-4857-a81c-7fc06c827375 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:12.891522 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4980eb4b-0f2c-4857-a81c-7fc06c827375 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:12.892278 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4980eb4b-0f2c-4857-a81c-7fc06c827375 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:12.893243 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4980eb4b-0f2c-4857-a81c-7fc06c827375 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:12.894135 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4980eb4b-0f2c-4857-a81c-7fc06c827375 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:12.895124 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4980eb4b-0f2c-4857-a81c-7fc06c827375 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:13.017484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e750a0d1-1ad2-4199-980d-1fbad538fcc3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:13.022149 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4980eb4b-0f2c-4857-a81c-7fc06c827375 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:13.031973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e750a0d1-1ad2-4199-980d-1fbad538fcc3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1292 microversion: 2.1 time: 0.374647 Aug 30 01:11:13.032691 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4980eb4b-0f2c-4857-a81c-7fc06c827375 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1296 microversion: 2.1 time: 0.167555 Aug 30 01:11:13.033590 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 28/48] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:12 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1292 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:13.064233 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 21/49] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:12 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1296 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:13.473569 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-223e4c17-2f8b-46c8-83e1-af03c632747f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:13.474237 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-223e4c17-2f8b-46c8-83e1-af03c632747f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:13.476467 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=6 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:13.484760 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-223e4c17-2f8b-46c8-83e1-af03c632747f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:13.485641 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-223e4c17-2f8b-46c8-83e1-af03c632747f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:13.486341 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-223e4c17-2f8b-46c8-83e1-af03c632747f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:13.487266 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-223e4c17-2f8b-46c8-83e1-af03c632747f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:13.491674 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-223e4c17-2f8b-46c8-83e1-af03c632747f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:13.492506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-223e4c17-2f8b-46c8-83e1-af03c632747f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:13.614631 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-223e4c17-2f8b-46c8-83e1-af03c632747f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:13.625633 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-223e4c17-2f8b-46c8-83e1-af03c632747f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:13.627108 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-223e4c17-2f8b-46c8-83e1-af03c632747f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:13.628235 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-223e4c17-2f8b-46c8-83e1-af03c632747f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1334 microversion: 2.20 time: 0.161186 Aug 30 01:11:13.634913 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 29/50] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:13 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1334 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:13.672744 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0cca1285-64ce-424b-9ba7-b038e08d178a tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:13.673364 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0cca1285-64ce-424b-9ba7-b038e08d178a tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:13.682282 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0cca1285-64ce-424b-9ba7-b038e08d178a tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:13.682772 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0cca1285-64ce-424b-9ba7-b038e08d178a tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:13.683207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0cca1285-64ce-424b-9ba7-b038e08d178a tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:13.683910 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0cca1285-64ce-424b-9ba7-b038e08d178a tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:13.684365 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0cca1285-64ce-424b-9ba7-b038e08d178a tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:13.684788 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0cca1285-64ce-424b-9ba7-b038e08d178a tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:13.735379 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e8ea2331-1c35-4677-bd07-d9ffa9a08188 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:13.736442 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e8ea2331-1c35-4677-bd07-d9ffa9a08188 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:13.744823 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8ea2331-1c35-4677-bd07-d9ffa9a08188 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:13.744823 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8ea2331-1c35-4677-bd07-d9ffa9a08188 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:13.744823 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8ea2331-1c35-4677-bd07-d9ffa9a08188 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:13.746084 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8ea2331-1c35-4677-bd07-d9ffa9a08188 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:13.746840 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8ea2331-1c35-4677-bd07-d9ffa9a08188 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:13.747621 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8ea2331-1c35-4677-bd07-d9ffa9a08188 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:13.769802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=100 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:13.804698 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0cca1285-64ce-424b-9ba7-b038e08d178a tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:13.822430 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0cca1285-64ce-424b-9ba7-b038e08d178a tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1273 microversion: 2.1 time: 0.153499 Aug 30 01:11:13.841850 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 22/51] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:13 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1273 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:13.896607 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e8ea2331-1c35-4677-bd07-d9ffa9a08188 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:13.919465 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e8ea2331-1c35-4677-bd07-d9ffa9a08188 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1291 microversion: 2.1 time: 0.189361 Aug 30 01:11:13.925121 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 30/52] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:13 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1291 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:14.059829 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-115b2929-8052-4036-8b88-c75a9c2cce6c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:14.062731 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-115b2929-8052-4036-8b88-c75a9c2cce6c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:14.063490 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-af4634e4-e7b6-44a1-b9b1-5ce9c51df3b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:14.064963 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-af4634e4-e7b6-44a1-b9b1-5ce9c51df3b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:14.088767 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-af4634e4-e7b6-44a1-b9b1-5ce9c51df3b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:14.089409 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-af4634e4-e7b6-44a1-b9b1-5ce9c51df3b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:14.090276 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-af4634e4-e7b6-44a1-b9b1-5ce9c51df3b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:14.090511 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-115b2929-8052-4036-8b88-c75a9c2cce6c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:14.091142 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-115b2929-8052-4036-8b88-c75a9c2cce6c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:14.097136 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-115b2929-8052-4036-8b88-c75a9c2cce6c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:14.097740 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-af4634e4-e7b6-44a1-b9b1-5ce9c51df3b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:14.100197 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-af4634e4-e7b6-44a1-b9b1-5ce9c51df3b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:14.100769 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-af4634e4-e7b6-44a1-b9b1-5ce9c51df3b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:14.100953 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-115b2929-8052-4036-8b88-c75a9c2cce6c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:14.101646 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-115b2929-8052-4036-8b88-c75a9c2cce6c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:14.105462 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-115b2929-8052-4036-8b88-c75a9c2cce6c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:14.269118 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-af4634e4-e7b6-44a1-b9b1-5ce9c51df3b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:14.277628 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-af4634e4-e7b6-44a1-b9b1-5ce9c51df3b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1292 microversion: 2.1 time: 0.224458 Aug 30 01:11:14.278247 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 31/53] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:14 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1292 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:14.401854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-115b2929-8052-4036-8b88-c75a9c2cce6c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:14.410665 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-115b2929-8052-4036-8b88-c75a9c2cce6c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.356502 Aug 30 01:11:14.411646 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 23/54] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:14 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:14.660477 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f61513e9-9779-4a3d-9d3d-c216b376de71 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:14.661237 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f61513e9-9779-4a3d-9d3d-c216b376de71 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:14.668708 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f61513e9-9779-4a3d-9d3d-c216b376de71 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:14.669781 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f61513e9-9779-4a3d-9d3d-c216b376de71 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:14.670310 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f61513e9-9779-4a3d-9d3d-c216b376de71 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:14.672161 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f61513e9-9779-4a3d-9d3d-c216b376de71 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:14.672893 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f61513e9-9779-4a3d-9d3d-c216b376de71 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:14.674787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f61513e9-9779-4a3d-9d3d-c216b376de71 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:14.768820 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f61513e9-9779-4a3d-9d3d-c216b376de71 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:14.785959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f61513e9-9779-4a3d-9d3d-c216b376de71 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:14.794025 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f61513e9-9779-4a3d-9d3d-c216b376de71 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:14.794025 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f61513e9-9779-4a3d-9d3d-c216b376de71 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1334 microversion: 2.20 time: 0.137594 Aug 30 01:11:14.799429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 32/55] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:14 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1334 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:14.814765 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-fe5e3c97-2d52-480c-94e0-8ff9c7f5fd55 req-f0f98c71-3df2-4fc2-b45e-37ea6635ad86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1388d14-c15e-4f95-9b68-944001f0d53a", "tag": "531e11a0-79a8-4242-9108-a01eaf852ae3"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:14.827765 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-fe5e3c97-2d52-480c-94e0-8ff9c7f5fd55 req-f0f98c71-3df2-4fc2-b45e-37ea6635ad86 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:14.828250 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-fe5e3c97-2d52-480c-94e0-8ff9c7f5fd55 req-f0f98c71-3df2-4fc2-b45e-37ea6635ad86 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:14.828808 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-fe5e3c97-2d52-480c-94e0-8ff9c7f5fd55 req-f0f98c71-3df2-4fc2-b45e-37ea6635ad86 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:14.848980 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a4b241be-bf9e-4043-8745-da9683966585 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:14.857095 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-fe5e3c97-2d52-480c-94e0-8ff9c7f5fd55 req-f0f98c71-3df2-4fc2-b45e-37ea6635ad86 service nova] Creating event network-changed:531e11a0-79a8-4242-9108-a01eaf852ae3 for instance e1388d14-c15e-4f95-9b68-944001f0d53a on hv-cinder-81571 Aug 30 01:11:14.857270 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a4b241be-bf9e-4043-8745-da9683966585 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:14.857388 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-fe5e3c97-2d52-480c-94e0-8ff9c7f5fd55 req-f0f98c71-3df2-4fc2-b45e-37ea6635ad86 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121232) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 01:11:14.857388 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-fe5e3c97-2d52-480c-94e0-8ff9c7f5fd55 req-f0f98c71-3df2-4fc2-b45e-37ea6635ad86 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121232) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 01:11:14.857388 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f608700-69a2-447b-b41e-6f7c491c8817 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:14.857388 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f608700-69a2-447b-b41e-6f7c491c8817 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:14.857388 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f608700-69a2-447b-b41e-6f7c491c8817 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:14.857849 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f608700-69a2-447b-b41e-6f7c491c8817 None None] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:14.857849 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f608700-69a2-447b-b41e-6f7c491c8817 None None] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:14.857849 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f608700-69a2-447b-b41e-6f7c491c8817 None None] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:14.863691 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.compute.rpcapi [None req-8f608700-69a2-447b-b41e-6f7c491c8817 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 01:11:14.864328 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a4b241be-bf9e-4043-8745-da9683966585 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:14.864707 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f608700-69a2-447b-b41e-6f7c491c8817 None None] Releasing lock "compute-rpcapi-router" {{(pid=121232) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 01:11:14.865031 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a4b241be-bf9e-4043-8745-da9683966585 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:14.865588 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a4b241be-bf9e-4043-8745-da9683966585 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:14.867218 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a4b241be-bf9e-4043-8745-da9683966585 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:14.867844 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a4b241be-bf9e-4043-8745-da9683966585 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:14.869284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a4b241be-bf9e-4043-8745-da9683966585 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:14.890367 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8f608700-69a2-447b-b41e-6f7c491c8817 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190420 Aug 30 01:11:14.891679 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 24/56] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:14.950165 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-29abb366-1183-4020-ac7e-71882e9ad1d3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:14.952009 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-29abb366-1183-4020-ac7e-71882e9ad1d3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:14.955383 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a4b241be-bf9e-4043-8745-da9683966585 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:14.959056 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29abb366-1183-4020-ac7e-71882e9ad1d3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:14.959531 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29abb366-1183-4020-ac7e-71882e9ad1d3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:14.959989 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29abb366-1183-4020-ac7e-71882e9ad1d3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:14.960820 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29abb366-1183-4020-ac7e-71882e9ad1d3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:14.961292 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29abb366-1183-4020-ac7e-71882e9ad1d3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:14.961708 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29abb366-1183-4020-ac7e-71882e9ad1d3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:14.964102 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a4b241be-bf9e-4043-8745-da9683966585 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1283 microversion: 2.1 time: 0.122785 Aug 30 01:11:14.965390 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 33/57] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:14 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1283 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:15.038276 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-29abb366-1183-4020-ac7e-71882e9ad1d3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:15.047008 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-29abb366-1183-4020-ac7e-71882e9ad1d3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1279 microversion: 2.1 time: 0.102278 Aug 30 01:11:15.057759 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 25/58] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:14 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:15.300607 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-123a899a-8bff-41ac-b54c-f407b2173807 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:15.301657 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-123a899a-8bff-41ac-b54c-f407b2173807 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:15.308466 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-123a899a-8bff-41ac-b54c-f407b2173807 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:15.309275 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-123a899a-8bff-41ac-b54c-f407b2173807 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:15.309967 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-123a899a-8bff-41ac-b54c-f407b2173807 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:15.311988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-123a899a-8bff-41ac-b54c-f407b2173807 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:15.312449 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-123a899a-8bff-41ac-b54c-f407b2173807 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:15.312896 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-123a899a-8bff-41ac-b54c-f407b2173807 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:15.381192 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-123a899a-8bff-41ac-b54c-f407b2173807 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:15.389643 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-123a899a-8bff-41ac-b54c-f407b2173807 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1300 microversion: 2.1 time: 0.094552 Aug 30 01:11:15.390257 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 34/59] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:15 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:15.433913 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-56af69c4-2f8d-4052-8987-a46d653cf57a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:15.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-56af69c4-2f8d-4052-8987-a46d653cf57a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:15.441411 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56af69c4-2f8d-4052-8987-a46d653cf57a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:15.441937 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56af69c4-2f8d-4052-8987-a46d653cf57a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:15.442374 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56af69c4-2f8d-4052-8987-a46d653cf57a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:15.443069 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56af69c4-2f8d-4052-8987-a46d653cf57a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:15.443524 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56af69c4-2f8d-4052-8987-a46d653cf57a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:15.443945 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56af69c4-2f8d-4052-8987-a46d653cf57a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:15.585201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-56af69c4-2f8d-4052-8987-a46d653cf57a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:15.593652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-56af69c4-2f8d-4052-8987-a46d653cf57a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.163880 Aug 30 01:11:15.595770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 26/60] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:15 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:15.821233 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-069fd59f-e759-4ee5-9940-8d6be2df163d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:15.821797 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-069fd59f-e759-4ee5-9940-8d6be2df163d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:15.828886 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-069fd59f-e759-4ee5-9940-8d6be2df163d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:15.829362 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-069fd59f-e759-4ee5-9940-8d6be2df163d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:15.829821 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-069fd59f-e759-4ee5-9940-8d6be2df163d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:15.830590 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-069fd59f-e759-4ee5-9940-8d6be2df163d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:15.831037 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-069fd59f-e759-4ee5-9940-8d6be2df163d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:15.831453 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-069fd59f-e759-4ee5-9940-8d6be2df163d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:15.893431 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-069fd59f-e759-4ee5-9940-8d6be2df163d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:15.901519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-069fd59f-e759-4ee5-9940-8d6be2df163d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:15.902982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-069fd59f-e759-4ee5-9940-8d6be2df163d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:15.904115 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-069fd59f-e759-4ee5-9940-8d6be2df163d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1334 microversion: 2.20 time: 0.087628 Aug 30 01:11:15.905250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 35/61] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:15 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:15.986274 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e06c2332-764d-42bd-855f-8df8f6285cc0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:15.986886 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e06c2332-764d-42bd-855f-8df8f6285cc0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:15.992775 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e06c2332-764d-42bd-855f-8df8f6285cc0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:15.993261 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e06c2332-764d-42bd-855f-8df8f6285cc0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:15.993700 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e06c2332-764d-42bd-855f-8df8f6285cc0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:15.994424 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e06c2332-764d-42bd-855f-8df8f6285cc0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:15.994885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e06c2332-764d-42bd-855f-8df8f6285cc0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:15.995312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e06c2332-764d-42bd-855f-8df8f6285cc0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:16.070042 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2a144fcd-d4c2-4895-8195-4cfe3904d732 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:16.070655 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2a144fcd-d4c2-4895-8195-4cfe3904d732 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:16.076855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2a144fcd-d4c2-4895-8195-4cfe3904d732 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:16.077344 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2a144fcd-d4c2-4895-8195-4cfe3904d732 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:16.077837 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2a144fcd-d4c2-4895-8195-4cfe3904d732 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:16.078513 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2a144fcd-d4c2-4895-8195-4cfe3904d732 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:16.078973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2a144fcd-d4c2-4895-8195-4cfe3904d732 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:16.079398 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2a144fcd-d4c2-4895-8195-4cfe3904d732 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:16.135719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e06c2332-764d-42bd-855f-8df8f6285cc0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:16.143746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e06c2332-764d-42bd-855f-8df8f6285cc0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1325 microversion: 2.1 time: 0.162106 Aug 30 01:11:16.144335 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 27/62] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:15 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1325 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:16.235556 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2a144fcd-d4c2-4895-8195-4cfe3904d732 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:16.243363 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2a144fcd-d4c2-4895-8195-4cfe3904d732 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.177133 Aug 30 01:11:16.243935 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 36/63] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:16 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:16.413787 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3f7d6d85-c291-410a-b562-fb8b65d663cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:16.413787 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3f7d6d85-c291-410a-b562-fb8b65d663cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:16.418334 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3f7d6d85-c291-410a-b562-fb8b65d663cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:16.418824 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3f7d6d85-c291-410a-b562-fb8b65d663cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:16.419263 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3f7d6d85-c291-410a-b562-fb8b65d663cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:16.420744 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3f7d6d85-c291-410a-b562-fb8b65d663cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:16.421420 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3f7d6d85-c291-410a-b562-fb8b65d663cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:16.421963 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3f7d6d85-c291-410a-b562-fb8b65d663cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:16.485393 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3f7d6d85-c291-410a-b562-fb8b65d663cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:16.489042 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:16.493556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3f7d6d85-c291-410a-b562-fb8b65d663cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1300 microversion: 2.1 time: 0.086151 Aug 30 01:11:16.494170 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 28/64] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:16 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:16.614583 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ea3b3e8d-c1df-4604-8ece-836b5bbb66ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:16.615189 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ea3b3e8d-c1df-4604-8ece-836b5bbb66ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:16.621106 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ea3b3e8d-c1df-4604-8ece-836b5bbb66ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:16.621581 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ea3b3e8d-c1df-4604-8ece-836b5bbb66ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:16.622050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ea3b3e8d-c1df-4604-8ece-836b5bbb66ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:16.622734 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ea3b3e8d-c1df-4604-8ece-836b5bbb66ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:16.623351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ea3b3e8d-c1df-4604-8ece-836b5bbb66ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:16.623799 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ea3b3e8d-c1df-4604-8ece-836b5bbb66ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:16.757788 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ea3b3e8d-c1df-4604-8ece-836b5bbb66ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:16.766379 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ea3b3e8d-c1df-4604-8ece-836b5bbb66ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.155586 Aug 30 01:11:16.767368 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 37/65] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:16 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:16.928029 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bb7114f9-451d-47c3-ad0d-2a89256122af tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:16.928671 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bb7114f9-451d-47c3-ad0d-2a89256122af tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:16.935146 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bb7114f9-451d-47c3-ad0d-2a89256122af tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:16.935646 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bb7114f9-451d-47c3-ad0d-2a89256122af tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:16.936079 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bb7114f9-451d-47c3-ad0d-2a89256122af tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:16.936782 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bb7114f9-451d-47c3-ad0d-2a89256122af tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:16.937236 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bb7114f9-451d-47c3-ad0d-2a89256122af tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:16.937665 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bb7114f9-451d-47c3-ad0d-2a89256122af tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:17.011334 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bb7114f9-451d-47c3-ad0d-2a89256122af tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:17.023251 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bb7114f9-451d-47c3-ad0d-2a89256122af tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:17.024731 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bb7114f9-451d-47c3-ad0d-2a89256122af tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:17.026107 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bb7114f9-451d-47c3-ad0d-2a89256122af tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1334 microversion: 2.20 time: 0.102287 Aug 30 01:11:17.026859 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 29/66] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:16 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1334 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:17.165557 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-322ecf8a-a9e3-4be9-8e44-04743d128ece tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:17.166362 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-322ecf8a-a9e3-4be9-8e44-04743d128ece tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:17.175140 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-322ecf8a-a9e3-4be9-8e44-04743d128ece tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:17.175627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-322ecf8a-a9e3-4be9-8e44-04743d128ece tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:17.176056 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-322ecf8a-a9e3-4be9-8e44-04743d128ece tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:17.176745 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-322ecf8a-a9e3-4be9-8e44-04743d128ece tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:17.177193 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-322ecf8a-a9e3-4be9-8e44-04743d128ece tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:17.177611 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-322ecf8a-a9e3-4be9-8e44-04743d128ece tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:17.267253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8317bb01-e8d4-4c60-9652-3e3be4ae8161 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:17.268245 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8317bb01-e8d4-4c60-9652-3e3be4ae8161 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:17.276184 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8317bb01-e8d4-4c60-9652-3e3be4ae8161 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:17.276680 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8317bb01-e8d4-4c60-9652-3e3be4ae8161 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:17.277121 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8317bb01-e8d4-4c60-9652-3e3be4ae8161 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:17.277899 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8317bb01-e8d4-4c60-9652-3e3be4ae8161 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:17.278459 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8317bb01-e8d4-4c60-9652-3e3be4ae8161 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:17.278820 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8317bb01-e8d4-4c60-9652-3e3be4ae8161 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:17.374746 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-322ecf8a-a9e3-4be9-8e44-04743d128ece tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:17.384162 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-322ecf8a-a9e3-4be9-8e44-04743d128ece tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1325 microversion: 2.1 time: 0.222759 Aug 30 01:11:17.392782 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 38/67] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:17 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1325 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:17.515110 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-75af40c3-1a4e-4a63-b18d-4ff2c5e6ce73 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:17.515736 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-75af40c3-1a4e-4a63-b18d-4ff2c5e6ce73 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:17.528739 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75af40c3-1a4e-4a63-b18d-4ff2c5e6ce73 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:17.529660 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75af40c3-1a4e-4a63-b18d-4ff2c5e6ce73 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:17.530541 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75af40c3-1a4e-4a63-b18d-4ff2c5e6ce73 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:17.531496 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75af40c3-1a4e-4a63-b18d-4ff2c5e6ce73 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:17.532151 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75af40c3-1a4e-4a63-b18d-4ff2c5e6ce73 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:17.532797 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75af40c3-1a4e-4a63-b18d-4ff2c5e6ce73 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:17.627468 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-75af40c3-1a4e-4a63-b18d-4ff2c5e6ce73 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:17.628291 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8317bb01-e8d4-4c60-9652-3e3be4ae8161 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:17.636372 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-75af40c3-1a4e-4a63-b18d-4ff2c5e6ce73 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1300 microversion: 2.1 time: 0.125575 Aug 30 01:11:17.636983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8317bb01-e8d4-4c60-9652-3e3be4ae8161 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.374106 Aug 30 01:11:17.637818 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 39/68] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:17 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1300 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:17.650316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 30/69] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:17 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:17.794503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-3de06cbb-50ab-43f9-bed1-d16f1564e012 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:17.795805 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-3de06cbb-50ab-43f9-bed1-d16f1564e012 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:17.802774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3de06cbb-50ab-43f9-bed1-d16f1564e012 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:17.803265 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3de06cbb-50ab-43f9-bed1-d16f1564e012 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:17.803705 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3de06cbb-50ab-43f9-bed1-d16f1564e012 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:17.804413 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3de06cbb-50ab-43f9-bed1-d16f1564e012 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:17.804869 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3de06cbb-50ab-43f9-bed1-d16f1564e012 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:17.805294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3de06cbb-50ab-43f9-bed1-d16f1564e012 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:17.951756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-3de06cbb-50ab-43f9-bed1-d16f1564e012 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:17.961141 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-3de06cbb-50ab-43f9-bed1-d16f1564e012 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.170367 Aug 30 01:11:17.968902 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 40/70] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:17 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:18.152602 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b1c12f9c-6cff-47fe-8491-e8012e22cd70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:18.152602 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b1c12f9c-6cff-47fe-8491-e8012e22cd70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:18.152602 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b1c12f9c-6cff-47fe-8491-e8012e22cd70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:18.152602 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b1c12f9c-6cff-47fe-8491-e8012e22cd70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:18.153995 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b1c12f9c-6cff-47fe-8491-e8012e22cd70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:18.153995 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b1c12f9c-6cff-47fe-8491-e8012e22cd70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:18.153995 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b1c12f9c-6cff-47fe-8491-e8012e22cd70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:18.153995 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b1c12f9c-6cff-47fe-8491-e8012e22cd70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:18.154511 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b1c12f9c-6cff-47fe-8491-e8012e22cd70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:18.154511 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b1c12f9c-6cff-47fe-8491-e8012e22cd70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:18.154722 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b1c12f9c-6cff-47fe-8491-e8012e22cd70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:18.154722 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b1c12f9c-6cff-47fe-8491-e8012e22cd70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1334 microversion: 2.20 time: 0.101145 Aug 30 01:11:18.154722 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 31/71] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:18 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:11:18.414428 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c8b4d0aa-7844-4d86-a5ac-0b4f0db409aa tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:18.415646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c8b4d0aa-7844-4d86-a5ac-0b4f0db409aa tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:18.425882 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c8b4d0aa-7844-4d86-a5ac-0b4f0db409aa tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:18.426627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c8b4d0aa-7844-4d86-a5ac-0b4f0db409aa tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:18.427253 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c8b4d0aa-7844-4d86-a5ac-0b4f0db409aa tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:18.428687 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c8b4d0aa-7844-4d86-a5ac-0b4f0db409aa tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:18.429383 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c8b4d0aa-7844-4d86-a5ac-0b4f0db409aa tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:18.429983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c8b4d0aa-7844-4d86-a5ac-0b4f0db409aa tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:18.612653 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c8b4d0aa-7844-4d86-a5ac-0b4f0db409aa tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:18.621823 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c8b4d0aa-7844-4d86-a5ac-0b4f0db409aa tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1325 microversion: 2.1 time: 0.212464 Aug 30 01:11:18.622401 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 41/72] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:18 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1325 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:18.660993 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e85264c2-d61f-473d-90ea-d8598fd2e696 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:18.662047 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e85264c2-d61f-473d-90ea-d8598fd2e696 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:18.662651 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6cd7ea92-ff18-484c-b6e4-6599e77946b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:18.663370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6cd7ea92-ff18-484c-b6e4-6599e77946b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:18.670987 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=36 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:18.672816 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6cd7ea92-ff18-484c-b6e4-6599e77946b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:18.672997 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e85264c2-d61f-473d-90ea-d8598fd2e696 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:18.673927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e85264c2-d61f-473d-90ea-d8598fd2e696 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:18.674241 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6cd7ea92-ff18-484c-b6e4-6599e77946b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:18.674701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e85264c2-d61f-473d-90ea-d8598fd2e696 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:18.674848 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6cd7ea92-ff18-484c-b6e4-6599e77946b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:18.675570 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e85264c2-d61f-473d-90ea-d8598fd2e696 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:18.675676 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6cd7ea92-ff18-484c-b6e4-6599e77946b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:18.676216 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6cd7ea92-ff18-484c-b6e4-6599e77946b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:18.676327 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e85264c2-d61f-473d-90ea-d8598fd2e696 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:18.676476 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6cd7ea92-ff18-484c-b6e4-6599e77946b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:18.677032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e85264c2-d61f-473d-90ea-d8598fd2e696 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:18.757779 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6cd7ea92-ff18-484c-b6e4-6599e77946b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:18.772255 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6cd7ea92-ff18-484c-b6e4-6599e77946b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1300 microversion: 2.1 time: 0.113446 Aug 30 01:11:18.772915 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 42/73] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:18 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1300 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:18.869574 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e85264c2-d61f-473d-90ea-d8598fd2e696 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:18.878723 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e85264c2-d61f-473d-90ea-d8598fd2e696 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.222593 Aug 30 01:11:18.889172 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 32/74] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:18 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:18.983838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-029d9367-2da3-427d-a9de-0c4942ce00e7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:18.984597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-029d9367-2da3-427d-a9de-0c4942ce00e7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:18.991384 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-029d9367-2da3-427d-a9de-0c4942ce00e7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:18.992192 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-029d9367-2da3-427d-a9de-0c4942ce00e7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:18.992743 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-029d9367-2da3-427d-a9de-0c4942ce00e7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:18.993584 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-029d9367-2da3-427d-a9de-0c4942ce00e7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:18.994167 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-029d9367-2da3-427d-a9de-0c4942ce00e7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:18.994701 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-029d9367-2da3-427d-a9de-0c4942ce00e7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:19.171837 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-029d9367-2da3-427d-a9de-0c4942ce00e7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:19.175164 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d86e3f2c-9193-43f5-9141-a7242b6453be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:19.176133 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d86e3f2c-9193-43f5-9141-a7242b6453be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:19.189620 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d86e3f2c-9193-43f5-9141-a7242b6453be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:19.189620 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d86e3f2c-9193-43f5-9141-a7242b6453be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:19.189620 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d86e3f2c-9193-43f5-9141-a7242b6453be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:19.189620 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d86e3f2c-9193-43f5-9141-a7242b6453be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:19.190313 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d86e3f2c-9193-43f5-9141-a7242b6453be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:19.190313 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d86e3f2c-9193-43f5-9141-a7242b6453be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:19.197888 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-029d9367-2da3-427d-a9de-0c4942ce00e7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.218382 Aug 30 01:11:19.210178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 43/75] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:18 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:19.282395 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d86e3f2c-9193-43f5-9141-a7242b6453be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:19.293325 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d86e3f2c-9193-43f5-9141-a7242b6453be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:19.295662 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d86e3f2c-9193-43f5-9141-a7242b6453be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:19.296887 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d86e3f2c-9193-43f5-9141-a7242b6453be tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1334 microversion: 2.20 time: 0.127494 Aug 30 01:11:19.311002 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 33/76] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:19 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1334 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:19.656777 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-08f66755-a137-4109-85a5-ed78ceb76694 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:19.657531 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-08f66755-a137-4109-85a5-ed78ceb76694 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:19.661999 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=32 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:19.705382 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-08f66755-a137-4109-85a5-ed78ceb76694 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:19.705382 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-08f66755-a137-4109-85a5-ed78ceb76694 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:19.705382 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-08f66755-a137-4109-85a5-ed78ceb76694 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:19.705382 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-08f66755-a137-4109-85a5-ed78ceb76694 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:19.706334 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-08f66755-a137-4109-85a5-ed78ceb76694 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:19.706334 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-08f66755-a137-4109-85a5-ed78ceb76694 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:19.796378 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4c1c3902-f912-45fb-9fa6-7361a63e5da7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:19.797168 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4c1c3902-f912-45fb-9fa6-7361a63e5da7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:19.804298 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c1c3902-f912-45fb-9fa6-7361a63e5da7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:19.804930 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c1c3902-f912-45fb-9fa6-7361a63e5da7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:19.806038 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c1c3902-f912-45fb-9fa6-7361a63e5da7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:19.807016 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c1c3902-f912-45fb-9fa6-7361a63e5da7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:19.807807 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c1c3902-f912-45fb-9fa6-7361a63e5da7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:19.808998 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c1c3902-f912-45fb-9fa6-7361a63e5da7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:19.833675 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-08f66755-a137-4109-85a5-ed78ceb76694 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:19.841777 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-08f66755-a137-4109-85a5-ed78ceb76694 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1325 microversion: 2.1 time: 0.197968 Aug 30 01:11:19.842367 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 44/77] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:19 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1325 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:19.891797 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4c1c3902-f912-45fb-9fa6-7361a63e5da7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:19.900179 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4c1c3902-f912-45fb-9fa6-7361a63e5da7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1300 microversion: 2.1 time: 0.109760 Aug 30 01:11:19.900751 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 34/78] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:19 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:19.902608 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-7e3a0a6c-cd4b-448c-9d0a-b0b32cf21faf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:19.903229 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-7e3a0a6c-cd4b-448c-9d0a-b0b32cf21faf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:19.909621 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7e3a0a6c-cd4b-448c-9d0a-b0b32cf21faf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:19.915637 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7e3a0a6c-cd4b-448c-9d0a-b0b32cf21faf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:19.916139 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7e3a0a6c-cd4b-448c-9d0a-b0b32cf21faf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:19.916892 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7e3a0a6c-cd4b-448c-9d0a-b0b32cf21faf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:19.917362 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7e3a0a6c-cd4b-448c-9d0a-b0b32cf21faf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:19.917810 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7e3a0a6c-cd4b-448c-9d0a-b0b32cf21faf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:20.068906 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7e3a0a6c-cd4b-448c-9d0a-b0b32cf21faf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:20.078544 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-7e3a0a6c-cd4b-448c-9d0a-b0b32cf21faf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.180989 Aug 30 01:11:20.079402 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 45/79] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:19 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:20.224383 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f28d31c1-4f45-49aa-810e-503797689752 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:20.225068 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f28d31c1-4f45-49aa-810e-503797689752 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:20.235524 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f28d31c1-4f45-49aa-810e-503797689752 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:20.236224 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f28d31c1-4f45-49aa-810e-503797689752 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:20.236835 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f28d31c1-4f45-49aa-810e-503797689752 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:20.237709 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f28d31c1-4f45-49aa-810e-503797689752 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:20.238353 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f28d31c1-4f45-49aa-810e-503797689752 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:20.238781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f28d31c1-4f45-49aa-810e-503797689752 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:20.325651 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5f89840e-b058-41ea-8fd1-b9d4d17b38d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:20.326472 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5f89840e-b058-41ea-8fd1-b9d4d17b38d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:20.333304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5f89840e-b058-41ea-8fd1-b9d4d17b38d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:20.333816 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5f89840e-b058-41ea-8fd1-b9d4d17b38d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:20.334256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5f89840e-b058-41ea-8fd1-b9d4d17b38d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:20.334950 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5f89840e-b058-41ea-8fd1-b9d4d17b38d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:20.335563 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5f89840e-b058-41ea-8fd1-b9d4d17b38d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:20.336132 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5f89840e-b058-41ea-8fd1-b9d4d17b38d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:20.587579 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5f89840e-b058-41ea-8fd1-b9d4d17b38d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:20.587579 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5f89840e-b058-41ea-8fd1-b9d4d17b38d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:20.587990 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f28d31c1-4f45-49aa-810e-503797689752 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:20.588097 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5f89840e-b058-41ea-8fd1-b9d4d17b38d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:20.588097 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5f89840e-b058-41ea-8fd1-b9d4d17b38d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1334 microversion: 2.20 time: 0.159927 Aug 30 01:11:20.588097 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 46/80] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:20 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1334 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:11:20.588386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f28d31c1-4f45-49aa-810e-503797689752 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.270592 Aug 30 01:11:20.588386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 35/81] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:20 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:20.868889 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2ced082d-b5c0-469b-86b8-2e91332515b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:20.869659 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2ced082d-b5c0-469b-86b8-2e91332515b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:20.877579 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ced082d-b5c0-469b-86b8-2e91332515b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:20.878096 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ced082d-b5c0-469b-86b8-2e91332515b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:20.878523 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ced082d-b5c0-469b-86b8-2e91332515b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:20.879211 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ced082d-b5c0-469b-86b8-2e91332515b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:20.879656 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ced082d-b5c0-469b-86b8-2e91332515b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:20.880118 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ced082d-b5c0-469b-86b8-2e91332515b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:20.884343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=100 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:20.923739 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-06a3e00a-ad3b-4d52-94e7-f626c35f3885 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:20.924361 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-06a3e00a-ad3b-4d52-94e7-f626c35f3885 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:20.935110 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06a3e00a-ad3b-4d52-94e7-f626c35f3885 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:20.936710 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06a3e00a-ad3b-4d52-94e7-f626c35f3885 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:20.937228 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06a3e00a-ad3b-4d52-94e7-f626c35f3885 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:20.938216 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06a3e00a-ad3b-4d52-94e7-f626c35f3885 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:20.939238 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06a3e00a-ad3b-4d52-94e7-f626c35f3885 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:20.939850 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06a3e00a-ad3b-4d52-94e7-f626c35f3885 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:21.021184 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-06a3e00a-ad3b-4d52-94e7-f626c35f3885 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:21.029452 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-06a3e00a-ad3b-4d52-94e7-f626c35f3885 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1300 microversion: 2.1 time: 0.110599 Aug 30 01:11:21.030183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 36/82] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:20 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:21.081521 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2ced082d-b5c0-469b-86b8-2e91332515b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:21.101503 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ceed5333-5a79-43b8-ab49-be4e01b8d1e1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:21.102146 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ceed5333-5a79-43b8-ab49-be4e01b8d1e1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:21.102339 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2ced082d-b5c0-469b-86b8-2e91332515b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1325 microversion: 2.1 time: 0.236862 Aug 30 01:11:21.103841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 47/83] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:20 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1325 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:21.113251 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceed5333-5a79-43b8-ab49-be4e01b8d1e1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:21.115441 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceed5333-5a79-43b8-ab49-be4e01b8d1e1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:21.116066 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceed5333-5a79-43b8-ab49-be4e01b8d1e1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:21.118240 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceed5333-5a79-43b8-ab49-be4e01b8d1e1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:21.163954 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceed5333-5a79-43b8-ab49-be4e01b8d1e1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:21.163954 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceed5333-5a79-43b8-ab49-be4e01b8d1e1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:21.274272 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ceed5333-5a79-43b8-ab49-be4e01b8d1e1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:21.282375 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ceed5333-5a79-43b8-ab49-be4e01b8d1e1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.184876 Aug 30 01:11:21.282945 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 37/84] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:21 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:21.605559 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f7593ca5-16c2-4986-9c36-d0225b0d5208 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:21.606239 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-79735143-9c7e-48a2-a8ee-064b43bfc744 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:21.606372 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f7593ca5-16c2-4986-9c36-d0225b0d5208 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:21.606835 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-79735143-9c7e-48a2-a8ee-064b43bfc744 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:21.613520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7593ca5-16c2-4986-9c36-d0225b0d5208 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:21.614039 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7593ca5-16c2-4986-9c36-d0225b0d5208 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:21.614404 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-79735143-9c7e-48a2-a8ee-064b43bfc744 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:21.614523 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7593ca5-16c2-4986-9c36-d0225b0d5208 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:21.615015 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-79735143-9c7e-48a2-a8ee-064b43bfc744 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:21.615164 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7593ca5-16c2-4986-9c36-d0225b0d5208 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:21.615512 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-79735143-9c7e-48a2-a8ee-064b43bfc744 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:21.615759 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7593ca5-16c2-4986-9c36-d0225b0d5208 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:21.616191 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7593ca5-16c2-4986-9c36-d0225b0d5208 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:21.616322 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-79735143-9c7e-48a2-a8ee-064b43bfc744 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:21.616755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-79735143-9c7e-48a2-a8ee-064b43bfc744 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:21.617178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-79735143-9c7e-48a2-a8ee-064b43bfc744 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:21.694145 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-79735143-9c7e-48a2-a8ee-064b43bfc744 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:21.701538 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-79735143-9c7e-48a2-a8ee-064b43bfc744 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:21.703022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-79735143-9c7e-48a2-a8ee-064b43bfc744 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:21.704164 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-79735143-9c7e-48a2-a8ee-064b43bfc744 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1334 microversion: 2.20 time: 0.101783 Aug 30 01:11:21.704725 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 38/85] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:21 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1334 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:11:21.793856 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f7593ca5-16c2-4986-9c36-d0225b0d5208 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:21.802656 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f7593ca5-16c2-4986-9c36-d0225b0d5208 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.201201 Aug 30 01:11:21.803225 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 48/86] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:21 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:22.050982 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fe9f3934-0b9c-4e4a-93a4-e0c9a7b61beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:22.052002 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fe9f3934-0b9c-4e4a-93a4-e0c9a7b61beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:22.058393 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe9f3934-0b9c-4e4a-93a4-e0c9a7b61beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:22.062253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe9f3934-0b9c-4e4a-93a4-e0c9a7b61beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:22.062253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe9f3934-0b9c-4e4a-93a4-e0c9a7b61beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:22.062253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe9f3934-0b9c-4e4a-93a4-e0c9a7b61beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:22.062253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe9f3934-0b9c-4e4a-93a4-e0c9a7b61beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:22.062705 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe9f3934-0b9c-4e4a-93a4-e0c9a7b61beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:22.134951 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fe9f3934-0b9c-4e4a-93a4-e0c9a7b61beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:22.143711 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fe9f3934-0b9c-4e4a-93a4-e0c9a7b61beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1300 microversion: 2.1 time: 0.096970 Aug 30 01:11:22.144292 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 39/87] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:22 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:22.170839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-8ceef3fe-7bc2-4ae7-9b69-d5e9673b71cc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:22.171604 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-8ceef3fe-7bc2-4ae7-9b69-d5e9673b71cc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:22.178082 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8ceef3fe-7bc2-4ae7-9b69-d5e9673b71cc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:22.178572 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8ceef3fe-7bc2-4ae7-9b69-d5e9673b71cc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:22.179163 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8ceef3fe-7bc2-4ae7-9b69-d5e9673b71cc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:22.185144 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8ceef3fe-7bc2-4ae7-9b69-d5e9673b71cc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:22.185849 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8ceef3fe-7bc2-4ae7-9b69-d5e9673b71cc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:22.186441 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8ceef3fe-7bc2-4ae7-9b69-d5e9673b71cc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:22.304951 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-90f76f26-3c73-41fe-9559-424a1e3b360d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:22.306421 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-90f76f26-3c73-41fe-9559-424a1e3b360d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:22.313844 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90f76f26-3c73-41fe-9559-424a1e3b360d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:22.314900 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90f76f26-3c73-41fe-9559-424a1e3b360d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:22.315571 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90f76f26-3c73-41fe-9559-424a1e3b360d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:22.316541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90f76f26-3c73-41fe-9559-424a1e3b360d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:22.317105 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90f76f26-3c73-41fe-9559-424a1e3b360d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:22.317858 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90f76f26-3c73-41fe-9559-424a1e3b360d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:22.345750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-8ceef3fe-7bc2-4ae7-9b69-d5e9673b71cc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:22.353824 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-8ceef3fe-7bc2-4ae7-9b69-d5e9673b71cc tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1325 microversion: 2.1 time: 0.187163 Aug 30 01:11:22.354408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 49/88] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:22 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1325 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:22.470911 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-90f76f26-3c73-41fe-9559-424a1e3b360d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:22.479074 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-90f76f26-3c73-41fe-9559-424a1e3b360d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.178395 Aug 30 01:11:22.484817 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 40/89] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:22 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:22.728278 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-059abe83-0c15-448b-bfe1-4bf46d4405c3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:22.728891 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-059abe83-0c15-448b-bfe1-4bf46d4405c3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:22.736205 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-059abe83-0c15-448b-bfe1-4bf46d4405c3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:22.736702 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-059abe83-0c15-448b-bfe1-4bf46d4405c3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:22.739084 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-059abe83-0c15-448b-bfe1-4bf46d4405c3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:22.740108 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-059abe83-0c15-448b-bfe1-4bf46d4405c3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:22.740577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-059abe83-0c15-448b-bfe1-4bf46d4405c3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:22.741008 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-059abe83-0c15-448b-bfe1-4bf46d4405c3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:22.830754 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-059abe83-0c15-448b-bfe1-4bf46d4405c3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:22.835495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-53ef51be-14b2-4293-9472-ad7aee09486e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:22.836127 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-53ef51be-14b2-4293-9472-ad7aee09486e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:22.844812 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-53ef51be-14b2-4293-9472-ad7aee09486e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:22.845310 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-53ef51be-14b2-4293-9472-ad7aee09486e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:22.845774 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-53ef51be-14b2-4293-9472-ad7aee09486e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:22.846494 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-53ef51be-14b2-4293-9472-ad7aee09486e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:22.846954 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-53ef51be-14b2-4293-9472-ad7aee09486e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:22.847386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-53ef51be-14b2-4293-9472-ad7aee09486e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:22.848199 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-059abe83-0c15-448b-bfe1-4bf46d4405c3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:22.850112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-059abe83-0c15-448b-bfe1-4bf46d4405c3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:22.851607 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-059abe83-0c15-448b-bfe1-4bf46d4405c3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1334 microversion: 2.20 time: 0.127422 Aug 30 01:11:22.862210 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 50/90] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:22 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1334 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:23.059012 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-53ef51be-14b2-4293-9472-ad7aee09486e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:23.067677 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-53ef51be-14b2-4293-9472-ad7aee09486e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.246949 Aug 30 01:11:23.074404 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 41/91] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:22 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:23.167300 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9feb89ed-1f16-4ae1-b9eb-fff3ea1f0e6d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:23.168165 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9feb89ed-1f16-4ae1-b9eb-fff3ea1f0e6d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:23.175854 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9feb89ed-1f16-4ae1-b9eb-fff3ea1f0e6d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:23.176513 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9feb89ed-1f16-4ae1-b9eb-fff3ea1f0e6d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:23.176979 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9feb89ed-1f16-4ae1-b9eb-fff3ea1f0e6d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:23.177775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9feb89ed-1f16-4ae1-b9eb-fff3ea1f0e6d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:23.178405 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9feb89ed-1f16-4ae1-b9eb-fff3ea1f0e6d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:23.178829 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9feb89ed-1f16-4ae1-b9eb-fff3ea1f0e6d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:23.246283 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9feb89ed-1f16-4ae1-b9eb-fff3ea1f0e6d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:23.254477 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9feb89ed-1f16-4ae1-b9eb-fff3ea1f0e6d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1300 microversion: 2.1 time: 0.093918 Aug 30 01:11:23.255053 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 51/92] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:23 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:23.376570 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bf4f25ff-bb48-490e-9248-187fd9793044 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:23.377301 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bf4f25ff-bb48-490e-9248-187fd9793044 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:23.384020 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf4f25ff-bb48-490e-9248-187fd9793044 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:23.384511 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf4f25ff-bb48-490e-9248-187fd9793044 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:23.384945 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf4f25ff-bb48-490e-9248-187fd9793044 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:23.385658 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf4f25ff-bb48-490e-9248-187fd9793044 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:23.386158 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf4f25ff-bb48-490e-9248-187fd9793044 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:23.386589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf4f25ff-bb48-490e-9248-187fd9793044 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:23.501183 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-409b1f90-7692-4e54-b627-67acd9adbd06 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:23.502018 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-409b1f90-7692-4e54-b627-67acd9adbd06 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:23.508680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-409b1f90-7692-4e54-b627-67acd9adbd06 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:23.509296 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-409b1f90-7692-4e54-b627-67acd9adbd06 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:23.509864 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-409b1f90-7692-4e54-b627-67acd9adbd06 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:23.518923 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-409b1f90-7692-4e54-b627-67acd9adbd06 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:23.518923 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-409b1f90-7692-4e54-b627-67acd9adbd06 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:23.518923 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-409b1f90-7692-4e54-b627-67acd9adbd06 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:23.535873 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bf4f25ff-bb48-490e-9248-187fd9793044 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:23.545015 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bf4f25ff-bb48-490e-9248-187fd9793044 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1325 microversion: 2.1 time: 0.171892 Aug 30 01:11:23.548609 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 42/93] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:23 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1325 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:23.648254 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-409b1f90-7692-4e54-b627-67acd9adbd06 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:23.657614 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-409b1f90-7692-4e54-b627-67acd9adbd06 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.160948 Aug 30 01:11:23.658219 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 52/94] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:23 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:23.876734 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-661e6599-e4d9-46aa-b9b4-7cdb45d786e8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:23.877341 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-661e6599-e4d9-46aa-b9b4-7cdb45d786e8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:23.883627 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-661e6599-e4d9-46aa-b9b4-7cdb45d786e8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:23.884113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-661e6599-e4d9-46aa-b9b4-7cdb45d786e8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:23.884550 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-661e6599-e4d9-46aa-b9b4-7cdb45d786e8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:23.885278 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-661e6599-e4d9-46aa-b9b4-7cdb45d786e8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:23.885750 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-661e6599-e4d9-46aa-b9b4-7cdb45d786e8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:23.886186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-661e6599-e4d9-46aa-b9b4-7cdb45d786e8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:23.947952 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-661e6599-e4d9-46aa-b9b4-7cdb45d786e8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:23.956911 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-661e6599-e4d9-46aa-b9b4-7cdb45d786e8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:23.958372 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-661e6599-e4d9-46aa-b9b4-7cdb45d786e8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:23.959461 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-661e6599-e4d9-46aa-b9b4-7cdb45d786e8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1334 microversion: 2.20 time: 0.087143 Aug 30 01:11:23.960043 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 43/95] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:23 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:11:24.107545 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-25f7222c-e4e6-4415-b41d-ef05fbec99c6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:24.108176 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-25f7222c-e4e6-4415-b41d-ef05fbec99c6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:24.114155 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25f7222c-e4e6-4415-b41d-ef05fbec99c6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:24.114647 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25f7222c-e4e6-4415-b41d-ef05fbec99c6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:24.115082 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25f7222c-e4e6-4415-b41d-ef05fbec99c6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:24.115774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25f7222c-e4e6-4415-b41d-ef05fbec99c6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:24.116227 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25f7222c-e4e6-4415-b41d-ef05fbec99c6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:24.116651 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25f7222c-e4e6-4415-b41d-ef05fbec99c6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:24.245703 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-25f7222c-e4e6-4415-b41d-ef05fbec99c6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:24.254476 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-25f7222c-e4e6-4415-b41d-ef05fbec99c6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.151018 Aug 30 01:11:24.255045 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 53/96] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:24 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:24.275189 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3d356f3c-00b3-47c9-95fa-16fa89b30591 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:24.275785 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3d356f3c-00b3-47c9-95fa-16fa89b30591 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:24.281759 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d356f3c-00b3-47c9-95fa-16fa89b30591 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:24.282243 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d356f3c-00b3-47c9-95fa-16fa89b30591 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:24.282671 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d356f3c-00b3-47c9-95fa-16fa89b30591 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:24.283355 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d356f3c-00b3-47c9-95fa-16fa89b30591 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:24.283811 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d356f3c-00b3-47c9-95fa-16fa89b30591 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:24.284230 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d356f3c-00b3-47c9-95fa-16fa89b30591 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:24.346086 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3d356f3c-00b3-47c9-95fa-16fa89b30591 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:24.353744 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3d356f3c-00b3-47c9-95fa-16fa89b30591 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1300 microversion: 2.1 time: 0.082352 Aug 30 01:11:24.354315 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 44/97] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:24 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:24.566496 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e4c0c9fb-6270-48f4-88b9-71358e7ce74d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:24.567145 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e4c0c9fb-6270-48f4-88b9-71358e7ce74d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:24.573088 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e4c0c9fb-6270-48f4-88b9-71358e7ce74d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:24.573569 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e4c0c9fb-6270-48f4-88b9-71358e7ce74d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:24.574032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e4c0c9fb-6270-48f4-88b9-71358e7ce74d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:24.574715 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e4c0c9fb-6270-48f4-88b9-71358e7ce74d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:24.575166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e4c0c9fb-6270-48f4-88b9-71358e7ce74d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:24.575587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e4c0c9fb-6270-48f4-88b9-71358e7ce74d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:24.679052 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5ed1c12f-a377-4a22-bb61-95d271b8aca4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:24.681328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5ed1c12f-a377-4a22-bb61-95d271b8aca4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:24.685625 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ed1c12f-a377-4a22-bb61-95d271b8aca4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:24.686133 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ed1c12f-a377-4a22-bb61-95d271b8aca4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:24.686572 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ed1c12f-a377-4a22-bb61-95d271b8aca4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:24.687336 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ed1c12f-a377-4a22-bb61-95d271b8aca4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:24.687844 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ed1c12f-a377-4a22-bb61-95d271b8aca4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:24.688215 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ed1c12f-a377-4a22-bb61-95d271b8aca4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:24.707133 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e4c0c9fb-6270-48f4-88b9-71358e7ce74d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:24.707254 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:24.714645 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e4c0c9fb-6270-48f4-88b9-71358e7ce74d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1325 microversion: 2.1 time: 0.151963 Aug 30 01:11:24.715226 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 54/98] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:24 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1325 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:24.830631 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5ed1c12f-a377-4a22-bb61-95d271b8aca4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:24.838298 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5ed1c12f-a377-4a22-bb61-95d271b8aca4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.163134 Aug 30 01:11:24.838872 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 45/99] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:24 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:24.981799 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-986c812e-8889-437d-a161-638ed94b34c7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:24.982397 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-986c812e-8889-437d-a161-638ed94b34c7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:24.988541 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-986c812e-8889-437d-a161-638ed94b34c7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:24.989020 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-986c812e-8889-437d-a161-638ed94b34c7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:24.989454 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-986c812e-8889-437d-a161-638ed94b34c7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:24.990171 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-986c812e-8889-437d-a161-638ed94b34c7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:24.990626 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-986c812e-8889-437d-a161-638ed94b34c7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:24.996459 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-986c812e-8889-437d-a161-638ed94b34c7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.056004 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-986c812e-8889-437d-a161-638ed94b34c7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:25.064168 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-986c812e-8889-437d-a161-638ed94b34c7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:25.065593 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-986c812e-8889-437d-a161-638ed94b34c7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:25.066771 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-986c812e-8889-437d-a161-638ed94b34c7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1334 microversion: 2.20 time: 0.088994 Aug 30 01:11:25.067337 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 55/100] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:24 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:25.275423 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2eef4735-7bd6-4609-9716-c29832465513 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:25.275956 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2eef4735-7bd6-4609-9716-c29832465513 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:25.277776 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=8 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:25.283406 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2eef4735-7bd6-4609-9716-c29832465513 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.283894 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2eef4735-7bd6-4609-9716-c29832465513 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.284337 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2eef4735-7bd6-4609-9716-c29832465513 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.285034 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2eef4735-7bd6-4609-9716-c29832465513 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.285490 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2eef4735-7bd6-4609-9716-c29832465513 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.286025 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2eef4735-7bd6-4609-9716-c29832465513 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.375732 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-7160fd8e-e98c-4e30-8272-5d75e2351cb9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:25.376488 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-7160fd8e-e98c-4e30-8272-5d75e2351cb9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:25.383336 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7160fd8e-e98c-4e30-8272-5d75e2351cb9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.383823 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7160fd8e-e98c-4e30-8272-5d75e2351cb9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.384252 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7160fd8e-e98c-4e30-8272-5d75e2351cb9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.384989 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7160fd8e-e98c-4e30-8272-5d75e2351cb9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.385441 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7160fd8e-e98c-4e30-8272-5d75e2351cb9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.385894 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7160fd8e-e98c-4e30-8272-5d75e2351cb9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.418508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2eef4735-7bd6-4609-9716-c29832465513 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:25.426743 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2eef4735-7bd6-4609-9716-c29832465513 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.155653 Aug 30 01:11:25.427537 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 46/101] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:25 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:25.449682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7160fd8e-e98c-4e30-8272-5d75e2351cb9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:25.458171 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-7160fd8e-e98c-4e30-8272-5d75e2351cb9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1300 microversion: 2.1 time: 0.086805 Aug 30 01:11:25.458755 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 56/102] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:25 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:25.737151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-82630f9c-8cd2-4709-8ed1-67d2dcfb4106 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:25.737833 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-82630f9c-8cd2-4709-8ed1-67d2dcfb4106 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:25.744256 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82630f9c-8cd2-4709-8ed1-67d2dcfb4106 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.744786 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82630f9c-8cd2-4709-8ed1-67d2dcfb4106 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.745229 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82630f9c-8cd2-4709-8ed1-67d2dcfb4106 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.745957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82630f9c-8cd2-4709-8ed1-67d2dcfb4106 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.746424 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82630f9c-8cd2-4709-8ed1-67d2dcfb4106 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.746865 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82630f9c-8cd2-4709-8ed1-67d2dcfb4106 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.860135 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a0cb377e-4fcb-4058-9a19-2212863f9f7b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:25.860747 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a0cb377e-4fcb-4058-9a19-2212863f9f7b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:25.867106 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a0cb377e-4fcb-4058-9a19-2212863f9f7b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.868372 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a0cb377e-4fcb-4058-9a19-2212863f9f7b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.868843 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a0cb377e-4fcb-4058-9a19-2212863f9f7b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.869547 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a0cb377e-4fcb-4058-9a19-2212863f9f7b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:25.870037 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a0cb377e-4fcb-4058-9a19-2212863f9f7b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:25.870460 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a0cb377e-4fcb-4058-9a19-2212863f9f7b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:25.878915 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-82630f9c-8cd2-4709-8ed1-67d2dcfb4106 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:25.893901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-82630f9c-8cd2-4709-8ed1-67d2dcfb4106 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1325 microversion: 2.1 time: 0.161823 Aug 30 01:11:25.896464 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 47/103] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:25 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1325 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:26.010173 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a0cb377e-4fcb-4058-9a19-2212863f9f7b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:26.018272 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a0cb377e-4fcb-4058-9a19-2212863f9f7b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.162503 Aug 30 01:11:26.018924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 57/104] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:25 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:26.088720 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-50521bb5-de35-451d-a921-5c48b4ee3f4e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:26.089347 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-50521bb5-de35-451d-a921-5c48b4ee3f4e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:26.095900 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50521bb5-de35-451d-a921-5c48b4ee3f4e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:26.096376 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50521bb5-de35-451d-a921-5c48b4ee3f4e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:26.096827 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50521bb5-de35-451d-a921-5c48b4ee3f4e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:26.097575 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50521bb5-de35-451d-a921-5c48b4ee3f4e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:26.097960 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50521bb5-de35-451d-a921-5c48b4ee3f4e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:26.098379 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50521bb5-de35-451d-a921-5c48b4ee3f4e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:26.166517 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-50521bb5-de35-451d-a921-5c48b4ee3f4e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:26.177628 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-50521bb5-de35-451d-a921-5c48b4ee3f4e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:26.179698 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-50521bb5-de35-451d-a921-5c48b4ee3f4e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:26.181650 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-50521bb5-de35-451d-a921-5c48b4ee3f4e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1334 microversion: 2.20 time: 0.096744 Aug 30 01:11:26.190287 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 48/105] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:26 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:26.447815 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6c01c2c5-9205-4fc0-a0e5-4d80a1be42bf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:26.448540 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6c01c2c5-9205-4fc0-a0e5-4d80a1be42bf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:26.459988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c01c2c5-9205-4fc0-a0e5-4d80a1be42bf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:26.460573 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c01c2c5-9205-4fc0-a0e5-4d80a1be42bf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:26.461144 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c01c2c5-9205-4fc0-a0e5-4d80a1be42bf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:26.461983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c01c2c5-9205-4fc0-a0e5-4d80a1be42bf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:26.463327 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c01c2c5-9205-4fc0-a0e5-4d80a1be42bf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:26.463797 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c01c2c5-9205-4fc0-a0e5-4d80a1be42bf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:26.480632 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-63e592f1-17f3-44bf-8621-0a68af5d7151 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:26.485532 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-63e592f1-17f3-44bf-8621-0a68af5d7151 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:26.493752 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63e592f1-17f3-44bf-8621-0a68af5d7151 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:26.494247 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63e592f1-17f3-44bf-8621-0a68af5d7151 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:26.494861 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63e592f1-17f3-44bf-8621-0a68af5d7151 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:26.495725 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63e592f1-17f3-44bf-8621-0a68af5d7151 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:26.496619 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63e592f1-17f3-44bf-8621-0a68af5d7151 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:26.497209 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63e592f1-17f3-44bf-8621-0a68af5d7151 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:26.659664 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-63e592f1-17f3-44bf-8621-0a68af5d7151 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:26.676243 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-63e592f1-17f3-44bf-8621-0a68af5d7151 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1300 microversion: 2.1 time: 0.201280 Aug 30 01:11:26.679889 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 49/106] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:26 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1300 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:26.915074 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7be658e1-f079-4c4c-ad3e-ffeb06466484 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:26.916559 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7be658e1-f079-4c4c-ad3e-ffeb06466484 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:26.923454 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7be658e1-f079-4c4c-ad3e-ffeb06466484 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:26.924429 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7be658e1-f079-4c4c-ad3e-ffeb06466484 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:26.925034 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7be658e1-f079-4c4c-ad3e-ffeb06466484 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:26.925969 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7be658e1-f079-4c4c-ad3e-ffeb06466484 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:26.926574 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7be658e1-f079-4c4c-ad3e-ffeb06466484 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:26.927196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7be658e1-f079-4c4c-ad3e-ffeb06466484 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:27.174271 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7be658e1-f079-4c4c-ad3e-ffeb06466484 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:27.184830 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7be658e1-f079-4c4c-ad3e-ffeb06466484 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.272800 Aug 30 01:11:27.186465 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 50/107] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:26 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:27.196770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f4c202b5-9a5a-45b8-821b-d9c3552c71b7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:27.197493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f4c202b5-9a5a-45b8-821b-d9c3552c71b7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:27.211971 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f4c202b5-9a5a-45b8-821b-d9c3552c71b7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:27.212862 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f4c202b5-9a5a-45b8-821b-d9c3552c71b7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:27.213293 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f4c202b5-9a5a-45b8-821b-d9c3552c71b7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:27.214038 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f4c202b5-9a5a-45b8-821b-d9c3552c71b7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:27.218442 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f4c202b5-9a5a-45b8-821b-d9c3552c71b7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:27.219709 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f4c202b5-9a5a-45b8-821b-d9c3552c71b7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:27.428795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6c01c2c5-9205-4fc0-a0e5-4d80a1be42bf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:27.440862 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6c01c2c5-9205-4fc0-a0e5-4d80a1be42bf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.997203 Aug 30 01:11:27.441846 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 58/108] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:26 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:27.448805 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6970fa8d-ad2e-4d3f-835e-eead50f3765d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:27.450115 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6970fa8d-ad2e-4d3f-835e-eead50f3765d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:27.459544 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6970fa8d-ad2e-4d3f-835e-eead50f3765d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:27.460047 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6970fa8d-ad2e-4d3f-835e-eead50f3765d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:27.460630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6970fa8d-ad2e-4d3f-835e-eead50f3765d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:27.461901 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6970fa8d-ad2e-4d3f-835e-eead50f3765d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:27.463252 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6970fa8d-ad2e-4d3f-835e-eead50f3765d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:27.463703 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6970fa8d-ad2e-4d3f-835e-eead50f3765d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:27.664421 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6970fa8d-ad2e-4d3f-835e-eead50f3765d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:27.700019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6970fa8d-ad2e-4d3f-835e-eead50f3765d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:27.707204 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6970fa8d-ad2e-4d3f-835e-eead50f3765d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:27.708755 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6970fa8d-ad2e-4d3f-835e-eead50f3765d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1352 microversion: 2.20 time: 0.265570 Aug 30 01:11:27.715983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 59/109] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:27 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1352 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:27.727789 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-84e745b6-5aed-4631-a8ff-55e2ba4e8384 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:27.728869 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-84e745b6-5aed-4631-a8ff-55e2ba4e8384 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:27.749669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-84e745b6-5aed-4631-a8ff-55e2ba4e8384 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:27.750063 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f4c202b5-9a5a-45b8-821b-d9c3552c71b7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:27.751208 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-84e745b6-5aed-4631-a8ff-55e2ba4e8384 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:27.752214 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-84e745b6-5aed-4631-a8ff-55e2ba4e8384 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:27.755630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-84e745b6-5aed-4631-a8ff-55e2ba4e8384 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:27.756322 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-84e745b6-5aed-4631-a8ff-55e2ba4e8384 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:27.756832 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-84e745b6-5aed-4631-a8ff-55e2ba4e8384 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:27.769581 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f4c202b5-9a5a-45b8-821b-d9c3552c71b7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.579142 Aug 30 01:11:27.770203 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 51/110] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:27 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:27.875841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-84e745b6-5aed-4631-a8ff-55e2ba4e8384 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:27.889495 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-84e745b6-5aed-4631-a8ff-55e2ba4e8384 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1298 microversion: 2.1 time: 0.166755 Aug 30 01:11:27.889495 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 60/111] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:27 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1298 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:28.043884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-9aecd5a5-1171-45b3-be27-926dbb21c865 req-bd7a6c5c-ba5d-492b-b178-4df7f37a4c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b016168d-f295-4bb4-9da1-36472ad69576", "tag": "beaab680-9f79-4900-9963-851c36bf37f9"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:28.057588 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-9aecd5a5-1171-45b3-be27-926dbb21c865 req-bd7a6c5c-ba5d-492b-b178-4df7f37a4c0d service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:28.066602 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-9aecd5a5-1171-45b3-be27-926dbb21c865 req-bd7a6c5c-ba5d-492b-b178-4df7f37a4c0d service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:28.066602 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-9aecd5a5-1171-45b3-be27-926dbb21c865 req-bd7a6c5c-ba5d-492b-b178-4df7f37a4c0d service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:28.070052 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-9aecd5a5-1171-45b3-be27-926dbb21c865 req-bd7a6c5c-ba5d-492b-b178-4df7f37a4c0d service nova] Creating event network-changed:beaab680-9f79-4900-9963-851c36bf37f9 for instance b016168d-f295-4bb4-9da1-36472ad69576 on hv-cinder-81571 Aug 30 01:11:28.076828 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-9aecd5a5-1171-45b3-be27-926dbb21c865 req-bd7a6c5c-ba5d-492b-b178-4df7f37a4c0d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036054 Aug 30 01:11:28.077780 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 52/112] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:11:28.218175 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f162add5-ef0b-4242-9ea0-c9e28dbea819 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:28.219527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f162add5-ef0b-4242-9ea0-c9e28dbea819 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:28.227246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f162add5-ef0b-4242-9ea0-c9e28dbea819 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:28.228445 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f162add5-ef0b-4242-9ea0-c9e28dbea819 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:28.228991 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f162add5-ef0b-4242-9ea0-c9e28dbea819 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:28.229902 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f162add5-ef0b-4242-9ea0-c9e28dbea819 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:28.230579 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f162add5-ef0b-4242-9ea0-c9e28dbea819 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:28.231170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f162add5-ef0b-4242-9ea0-c9e28dbea819 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:28.487837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e9984694-a081-4432-8298-42ea09523716 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:28.487837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e9984694-a081-4432-8298-42ea09523716 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:28.487837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9984694-a081-4432-8298-42ea09523716 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:28.487837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9984694-a081-4432-8298-42ea09523716 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:28.488124 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9984694-a081-4432-8298-42ea09523716 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:28.488124 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9984694-a081-4432-8298-42ea09523716 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:28.488124 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9984694-a081-4432-8298-42ea09523716 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:28.488124 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9984694-a081-4432-8298-42ea09523716 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:28.873525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f162add5-ef0b-4242-9ea0-c9e28dbea819 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:28.884129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f162add5-ef0b-4242-9ea0-c9e28dbea819 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.672296 Aug 30 01:11:28.884655 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 61/113] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:28 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:28.890317 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a57d1fe3-7427-4f6f-b35a-2876b8360f51 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:28.891480 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a57d1fe3-7427-4f6f-b35a-2876b8360f51 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:28.898368 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a57d1fe3-7427-4f6f-b35a-2876b8360f51 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:28.899147 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a57d1fe3-7427-4f6f-b35a-2876b8360f51 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:28.901881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a57d1fe3-7427-4f6f-b35a-2876b8360f51 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:28.904960 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a57d1fe3-7427-4f6f-b35a-2876b8360f51 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:28.905484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a57d1fe3-7427-4f6f-b35a-2876b8360f51 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:28.907176 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a57d1fe3-7427-4f6f-b35a-2876b8360f51 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:29.139093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a57d1fe3-7427-4f6f-b35a-2876b8360f51 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:29.168806 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a57d1fe3-7427-4f6f-b35a-2876b8360f51 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:29.176737 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e9984694-a081-4432-8298-42ea09523716 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:29.183492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a57d1fe3-7427-4f6f-b35a-2876b8360f51 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:29.184411 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e9984694-a081-4432-8298-42ea09523716 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.725475 Aug 30 01:11:29.188659 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a57d1fe3-7427-4f6f-b35a-2876b8360f51 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1340 microversion: 2.20 time: 0.299453 Aug 30 01:11:29.189313 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 62/114] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:28 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1340 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:29.191043 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 53/115] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:28 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:29.195966 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f9c26b0f-f6c5-4c3e-8a20-5368cf6b8beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:29.198503 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f9c26b0f-f6c5-4c3e-8a20-5368cf6b8beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:29.209131 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9c26b0f-f6c5-4c3e-8a20-5368cf6b8beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:29.210225 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b79136ac-94ed-4a0b-a2a9-d9076d365e40 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:29.210225 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b79136ac-94ed-4a0b-a2a9-d9076d365e40 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:29.214443 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9c26b0f-f6c5-4c3e-8a20-5368cf6b8beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:29.215035 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9c26b0f-f6c5-4c3e-8a20-5368cf6b8beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:29.216075 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9c26b0f-f6c5-4c3e-8a20-5368cf6b8beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:29.219336 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9c26b0f-f6c5-4c3e-8a20-5368cf6b8beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:29.219587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b79136ac-94ed-4a0b-a2a9-d9076d365e40 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:29.220190 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f9c26b0f-f6c5-4c3e-8a20-5368cf6b8beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:29.220797 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b79136ac-94ed-4a0b-a2a9-d9076d365e40 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:29.221388 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b79136ac-94ed-4a0b-a2a9-d9076d365e40 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:29.222779 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b79136ac-94ed-4a0b-a2a9-d9076d365e40 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:29.223390 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b79136ac-94ed-4a0b-a2a9-d9076d365e40 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:29.224138 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b79136ac-94ed-4a0b-a2a9-d9076d365e40 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:29.556100 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-b79136ac-94ed-4a0b-a2a9-d9076d365e40 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:29.565472 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=100 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:29.574138 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-b79136ac-94ed-4a0b-a2a9-d9076d365e40 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.383036 Aug 30 01:11:29.575152 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 63/116] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:29 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:29.624029 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f9c26b0f-f6c5-4c3e-8a20-5368cf6b8beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:29.651515 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f9c26b0f-f6c5-4c3e-8a20-5368cf6b8beb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.459090 Aug 30 01:11:29.656553 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 54/117] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:29 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:29.678686 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-de3a2c6e-c7a4-4a4a-b787-54811b9c36db req-15c84856-9611-4543-9409-5124c0883c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30841f5c-b634-47dc-97ab-c651bf3ace8a", "tag": "d8d36366-3bec-4323-a577-34ce2e4beafd"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:29.710183 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-de3a2c6e-c7a4-4a4a-b787-54811b9c36db req-15c84856-9611-4543-9409-5124c0883c4d service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:29.711240 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-de3a2c6e-c7a4-4a4a-b787-54811b9c36db req-15c84856-9611-4543-9409-5124c0883c4d service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:29.711677 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-de3a2c6e-c7a4-4a4a-b787-54811b9c36db req-15c84856-9611-4543-9409-5124c0883c4d service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:29.748886 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-de3a2c6e-c7a4-4a4a-b787-54811b9c36db req-15c84856-9611-4543-9409-5124c0883c4d service nova] Creating event network-changed:d8d36366-3bec-4323-a577-34ce2e4beafd for instance 30841f5c-b634-47dc-97ab-c651bf3ace8a on hv-cinder-81571 Aug 30 01:11:29.750262 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-de3a2c6e-c7a4-4a4a-b787-54811b9c36db req-15c84856-9611-4543-9409-5124c0883c4d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121233) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 01:11:29.751184 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-de3a2c6e-c7a4-4a4a-b787-54811b9c36db req-15c84856-9611-4543-9409-5124c0883c4d service nova] Acquired lock "compute-rpcapi-router" {{(pid=121233) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 01:11:29.753141 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c5d1088d-3865-4780-9159-9fc751333975 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:29.754116 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c5d1088d-3865-4780-9159-9fc751333975 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:29.755029 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c5d1088d-3865-4780-9159-9fc751333975 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:29.756248 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c5d1088d-3865-4780-9159-9fc751333975 None None] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:29.756716 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c5d1088d-3865-4780-9159-9fc751333975 None None] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:29.757151 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c5d1088d-3865-4780-9159-9fc751333975 None None] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:29.767644 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.compute.rpcapi [None req-c5d1088d-3865-4780-9159-9fc751333975 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 01:11:29.773949 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c5d1088d-3865-4780-9159-9fc751333975 None None] Releasing lock "compute-rpcapi-router" {{(pid=121233) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 01:11:29.793143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c5d1088d-3865-4780-9159-9fc751333975 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214952 Aug 30 01:11:29.793788 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 64/118] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:29.909075 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-513d16d7-5b19-4f16-9c89-73e96afc78a8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:29.909689 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-513d16d7-5b19-4f16-9c89-73e96afc78a8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:29.916814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-513d16d7-5b19-4f16-9c89-73e96afc78a8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:29.917304 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-513d16d7-5b19-4f16-9c89-73e96afc78a8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:29.918095 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-513d16d7-5b19-4f16-9c89-73e96afc78a8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:29.918946 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-513d16d7-5b19-4f16-9c89-73e96afc78a8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:29.920354 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-513d16d7-5b19-4f16-9c89-73e96afc78a8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:29.920996 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-513d16d7-5b19-4f16-9c89-73e96afc78a8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:30.205423 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-513d16d7-5b19-4f16-9c89-73e96afc78a8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:30.215874 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-513d16d7-5b19-4f16-9c89-73e96afc78a8 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.312305 Aug 30 01:11:30.219378 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-7b8a6597-dfb4-4ce9-a94a-b73bbf1de101 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:30.221323 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-7b8a6597-dfb4-4ce9-a94a-b73bbf1de101 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:30.227904 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 55/119] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:29 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:30.237578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dc0bc1bc-a525-445e-93da-6302cd6c6ced tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:30.240575 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b8a6597-dfb4-4ce9-a94a-b73bbf1de101 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:30.240575 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b8a6597-dfb4-4ce9-a94a-b73bbf1de101 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:30.240792 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dc0bc1bc-a525-445e-93da-6302cd6c6ced tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:30.240893 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b8a6597-dfb4-4ce9-a94a-b73bbf1de101 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:30.240893 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b8a6597-dfb4-4ce9-a94a-b73bbf1de101 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:30.242203 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b8a6597-dfb4-4ce9-a94a-b73bbf1de101 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:30.242865 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b8a6597-dfb4-4ce9-a94a-b73bbf1de101 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:30.245582 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc0bc1bc-a525-445e-93da-6302cd6c6ced tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:30.246113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc0bc1bc-a525-445e-93da-6302cd6c6ced tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:30.246730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc0bc1bc-a525-445e-93da-6302cd6c6ced tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:30.247733 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc0bc1bc-a525-445e-93da-6302cd6c6ced tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:30.248638 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc0bc1bc-a525-445e-93da-6302cd6c6ced tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:30.249065 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc0bc1bc-a525-445e-93da-6302cd6c6ced tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:30.383838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7b8a6597-dfb4-4ce9-a94a-b73bbf1de101 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:30.394735 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-7b8a6597-dfb4-4ce9-a94a-b73bbf1de101 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.186396 Aug 30 01:11:30.409923 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 65/120] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:30 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:30.419787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-c7bd18db-136c-4de6-935d-1d3f10eb3a5c req-c62bfe21-851f-4d54-8f1b-814194dd5cef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aec6af1b-90af-41d0-9778-9c0d89e330bc", "tag": "66ac913d-aad3-451a-96e1-8f106967b9a5"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:30.432211 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-c7bd18db-136c-4de6-935d-1d3f10eb3a5c req-c62bfe21-851f-4d54-8f1b-814194dd5cef service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:30.432626 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-c7bd18db-136c-4de6-935d-1d3f10eb3a5c req-c62bfe21-851f-4d54-8f1b-814194dd5cef service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:30.433065 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-c7bd18db-136c-4de6-935d-1d3f10eb3a5c req-c62bfe21-851f-4d54-8f1b-814194dd5cef service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:30.454300 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-c7bd18db-136c-4de6-935d-1d3f10eb3a5c req-c62bfe21-851f-4d54-8f1b-814194dd5cef service nova] Creating event network-changed:66ac913d-aad3-451a-96e1-8f106967b9a5 for instance aec6af1b-90af-41d0-9778-9c0d89e330bc on hv-cinder-81571 Aug 30 01:11:30.459575 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-c7bd18db-136c-4de6-935d-1d3f10eb3a5c req-c62bfe21-851f-4d54-8f1b-814194dd5cef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048240 Aug 30 01:11:30.460186 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 66/121] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:30.485647 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dc0bc1bc-a525-445e-93da-6302cd6c6ced tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:30.501962 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dc0bc1bc-a525-445e-93da-6302cd6c6ced tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:30.503390 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dc0bc1bc-a525-445e-93da-6302cd6c6ced tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:30.504503 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dc0bc1bc-a525-445e-93da-6302cd6c6ced tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.275568 Aug 30 01:11:30.510001 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 56/122] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:30 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:30.599764 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-8816ae6f-ebfb-49d2-ad6a-331e2882ab16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:30.599764 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-8816ae6f-ebfb-49d2-ad6a-331e2882ab16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:30.603257 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8816ae6f-ebfb-49d2-ad6a-331e2882ab16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:30.603804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8816ae6f-ebfb-49d2-ad6a-331e2882ab16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:30.604299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8816ae6f-ebfb-49d2-ad6a-331e2882ab16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:30.605045 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8816ae6f-ebfb-49d2-ad6a-331e2882ab16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:30.605580 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8816ae6f-ebfb-49d2-ad6a-331e2882ab16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:30.606091 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8816ae6f-ebfb-49d2-ad6a-331e2882ab16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:30.675769 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-54d26f69-0a92-4ecd-a49c-c6f9947ae2de tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:30.676399 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-54d26f69-0a92-4ecd-a49c-c6f9947ae2de tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:30.682779 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54d26f69-0a92-4ecd-a49c-c6f9947ae2de tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:30.685495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54d26f69-0a92-4ecd-a49c-c6f9947ae2de tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:30.685495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54d26f69-0a92-4ecd-a49c-c6f9947ae2de tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:30.685495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54d26f69-0a92-4ecd-a49c-c6f9947ae2de tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:30.685495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54d26f69-0a92-4ecd-a49c-c6f9947ae2de tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:30.685951 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54d26f69-0a92-4ecd-a49c-c6f9947ae2de tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:30.762578 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-8816ae6f-ebfb-49d2-ad6a-331e2882ab16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:30.770815 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-8816ae6f-ebfb-49d2-ad6a-331e2882ab16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.179080 Aug 30 01:11:30.771389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 67/123] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:30 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:30.843835 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-54d26f69-0a92-4ecd-a49c-c6f9947ae2de tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:30.851550 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-54d26f69-0a92-4ecd-a49c-c6f9947ae2de tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.179944 Aug 30 01:11:30.852116 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 57/124] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:30 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:31.239918 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d0bfb82d-050d-4166-98d1-e8a46d2f274c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:31.240528 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d0bfb82d-050d-4166-98d1-e8a46d2f274c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:31.246813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d0bfb82d-050d-4166-98d1-e8a46d2f274c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:31.247289 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d0bfb82d-050d-4166-98d1-e8a46d2f274c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:31.248765 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d0bfb82d-050d-4166-98d1-e8a46d2f274c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:31.249464 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d0bfb82d-050d-4166-98d1-e8a46d2f274c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:31.249952 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d0bfb82d-050d-4166-98d1-e8a46d2f274c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:31.250378 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d0bfb82d-050d-4166-98d1-e8a46d2f274c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:31.417181 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6e7124cc-4642-4701-ab5d-bf4653e8a62c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:31.419072 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6e7124cc-4642-4701-ab5d-bf4653e8a62c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:31.426526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e7124cc-4642-4701-ab5d-bf4653e8a62c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:31.427172 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e7124cc-4642-4701-ab5d-bf4653e8a62c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:31.427798 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e7124cc-4642-4701-ab5d-bf4653e8a62c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:31.429226 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e7124cc-4642-4701-ab5d-bf4653e8a62c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:31.430156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e7124cc-4642-4701-ab5d-bf4653e8a62c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:31.430739 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e7124cc-4642-4701-ab5d-bf4653e8a62c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:31.432187 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d0bfb82d-050d-4166-98d1-e8a46d2f274c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:31.441115 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d0bfb82d-050d-4166-98d1-e8a46d2f274c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.204991 Aug 30 01:11:31.441697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 68/125] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:31 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:31.527468 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-544d3ed2-ee34-4639-b591-a1005a9a26e9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:31.528278 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-544d3ed2-ee34-4639-b591-a1005a9a26e9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:31.535032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-544d3ed2-ee34-4639-b591-a1005a9a26e9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:31.536225 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-544d3ed2-ee34-4639-b591-a1005a9a26e9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:31.536225 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-544d3ed2-ee34-4639-b591-a1005a9a26e9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:31.536752 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-544d3ed2-ee34-4639-b591-a1005a9a26e9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:31.537202 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-544d3ed2-ee34-4639-b591-a1005a9a26e9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:31.537622 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-544d3ed2-ee34-4639-b591-a1005a9a26e9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:31.578249 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6e7124cc-4642-4701-ab5d-bf4653e8a62c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:31.586882 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6e7124cc-4642-4701-ab5d-bf4653e8a62c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.173435 Aug 30 01:11:31.587551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 58/126] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:31 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:31.743760 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-544d3ed2-ee34-4639-b591-a1005a9a26e9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:31.753485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-544d3ed2-ee34-4639-b591-a1005a9a26e9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:31.754986 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-544d3ed2-ee34-4639-b591-a1005a9a26e9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:31.756289 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-544d3ed2-ee34-4639-b591-a1005a9a26e9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.232955 Aug 30 01:11:31.756706 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 69/127] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:31 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:31.791924 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-42c30f92-0ef1-4eea-a488-e54220267ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:31.792405 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-42c30f92-0ef1-4eea-a488-e54220267ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:31.799404 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-42c30f92-0ef1-4eea-a488-e54220267ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:31.799893 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-42c30f92-0ef1-4eea-a488-e54220267ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:31.800330 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-42c30f92-0ef1-4eea-a488-e54220267ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:31.801025 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-42c30f92-0ef1-4eea-a488-e54220267ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:31.801485 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-42c30f92-0ef1-4eea-a488-e54220267ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:31.801939 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-42c30f92-0ef1-4eea-a488-e54220267ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:31.817027 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-fa5d496a-58f0-4a09-b90a-06e9cffa301c req-16758de6-7fb7-49c0-91ad-26177945267f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5022a2c4-6b00-416c-9a13-63b0dec702b2", "tag": "c67f9947-1307-4c65-b66d-e90b9d577330"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:31.826855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-fa5d496a-58f0-4a09-b90a-06e9cffa301c req-16758de6-7fb7-49c0-91ad-26177945267f service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:31.827912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-fa5d496a-58f0-4a09-b90a-06e9cffa301c req-16758de6-7fb7-49c0-91ad-26177945267f service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:31.827912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-fa5d496a-58f0-4a09-b90a-06e9cffa301c req-16758de6-7fb7-49c0-91ad-26177945267f service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:31.841539 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-fa5d496a-58f0-4a09-b90a-06e9cffa301c req-16758de6-7fb7-49c0-91ad-26177945267f service nova] Creating event network-changed:c67f9947-1307-4c65-b66d-e90b9d577330 for instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 on hv-cinder-81571 Aug 30 01:11:31.846965 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-fa5d496a-58f0-4a09-b90a-06e9cffa301c req-16758de6-7fb7-49c0-91ad-26177945267f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033575 Aug 30 01:11:31.847870 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 70/128] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:11:31.878119 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-047ac182-8561-4cbc-9829-4c39e56e3549 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:31.879309 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-047ac182-8561-4cbc-9829-4c39e56e3549 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:31.887477 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-047ac182-8561-4cbc-9829-4c39e56e3549 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:31.888009 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-047ac182-8561-4cbc-9829-4c39e56e3549 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:31.888460 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-047ac182-8561-4cbc-9829-4c39e56e3549 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:31.889197 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-047ac182-8561-4cbc-9829-4c39e56e3549 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:31.889653 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-047ac182-8561-4cbc-9829-4c39e56e3549 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:31.890124 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-047ac182-8561-4cbc-9829-4c39e56e3549 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:31.978634 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-42c30f92-0ef1-4eea-a488-e54220267ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:31.987454 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-42c30f92-0ef1-4eea-a488-e54220267ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.199459 Aug 30 01:11:31.992363 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 59/129] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:31 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:32.083001 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-047ac182-8561-4cbc-9829-4c39e56e3549 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:32.090760 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-047ac182-8561-4cbc-9829-4c39e56e3549 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.218904 Aug 30 01:11:32.091893 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 71/130] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:31 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:32.462754 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-37063b63-1a49-4527-b06b-a50aa98e7f15 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:32.463366 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-37063b63-1a49-4527-b06b-a50aa98e7f15 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:32.469482 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37063b63-1a49-4527-b06b-a50aa98e7f15 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:32.470123 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37063b63-1a49-4527-b06b-a50aa98e7f15 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:32.470542 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37063b63-1a49-4527-b06b-a50aa98e7f15 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:32.471238 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37063b63-1a49-4527-b06b-a50aa98e7f15 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:32.471692 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37063b63-1a49-4527-b06b-a50aa98e7f15 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:32.472113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37063b63-1a49-4527-b06b-a50aa98e7f15 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:32.609075 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-29abdaaf-0fbc-4339-8bc7-258919f65bf4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:32.610376 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-29abdaaf-0fbc-4339-8bc7-258919f65bf4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:32.615390 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-37063b63-1a49-4527-b06b-a50aa98e7f15 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:32.617119 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-29abdaaf-0fbc-4339-8bc7-258919f65bf4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:32.617603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-29abdaaf-0fbc-4339-8bc7-258919f65bf4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:32.618403 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-29abdaaf-0fbc-4339-8bc7-258919f65bf4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:32.619140 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-29abdaaf-0fbc-4339-8bc7-258919f65bf4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:32.619593 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-29abdaaf-0fbc-4339-8bc7-258919f65bf4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:32.620013 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-29abdaaf-0fbc-4339-8bc7-258919f65bf4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:32.626313 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-37063b63-1a49-4527-b06b-a50aa98e7f15 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.167226 Aug 30 01:11:32.627147 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 60/131] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:32 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:32.778546 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d1d0ab47-dcef-43a4-a3f7-ce5867890bdc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:32.779665 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d1d0ab47-dcef-43a4-a3f7-ce5867890bdc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:32.785745 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1d0ab47-dcef-43a4-a3f7-ce5867890bdc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:32.786247 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1d0ab47-dcef-43a4-a3f7-ce5867890bdc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:32.786668 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1d0ab47-dcef-43a4-a3f7-ce5867890bdc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:32.787350 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1d0ab47-dcef-43a4-a3f7-ce5867890bdc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:32.787796 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1d0ab47-dcef-43a4-a3f7-ce5867890bdc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:32.788214 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1d0ab47-dcef-43a4-a3f7-ce5867890bdc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:32.813442 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-29abdaaf-0fbc-4339-8bc7-258919f65bf4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:32.834820 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-29abdaaf-0fbc-4339-8bc7-258919f65bf4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.228857 Aug 30 01:11:32.835425 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 72/132] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:32 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:32.944656 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d1d0ab47-dcef-43a4-a3f7-ce5867890bdc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:32.958068 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d1d0ab47-dcef-43a4-a3f7-ce5867890bdc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:32.959657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d1d0ab47-dcef-43a4-a3f7-ce5867890bdc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:32.960713 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d1d0ab47-dcef-43a4-a3f7-ce5867890bdc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.186156 Aug 30 01:11:32.962314 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 61/133] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:32 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:11:33.022059 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-07086c5c-b245-4566-97b3-3f6e1c33c483 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:33.022849 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-07086c5c-b245-4566-97b3-3f6e1c33c483 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:33.030992 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07086c5c-b245-4566-97b3-3f6e1c33c483 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:33.032236 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07086c5c-b245-4566-97b3-3f6e1c33c483 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:33.033342 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07086c5c-b245-4566-97b3-3f6e1c33c483 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:33.035078 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07086c5c-b245-4566-97b3-3f6e1c33c483 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:33.035777 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07086c5c-b245-4566-97b3-3f6e1c33c483 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:33.036423 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07086c5c-b245-4566-97b3-3f6e1c33c483 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:33.114309 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2299f3cb-e7e9-4725-ad67-529135dea002 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:33.115449 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2299f3cb-e7e9-4725-ad67-529135dea002 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:33.119204 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:33.124619 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2299f3cb-e7e9-4725-ad67-529135dea002 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:33.125393 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2299f3cb-e7e9-4725-ad67-529135dea002 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:33.126141 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2299f3cb-e7e9-4725-ad67-529135dea002 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:33.127052 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2299f3cb-e7e9-4725-ad67-529135dea002 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:33.127575 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2299f3cb-e7e9-4725-ad67-529135dea002 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:33.128169 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2299f3cb-e7e9-4725-ad67-529135dea002 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:33.215311 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-07086c5c-b245-4566-97b3-3f6e1c33c483 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:33.225213 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-07086c5c-b245-4566-97b3-3f6e1c33c483 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.217313 Aug 30 01:11:33.227431 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 73/134] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:33 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:33.368614 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2299f3cb-e7e9-4725-ad67-529135dea002 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:33.374173 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:33.382477 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2299f3cb-e7e9-4725-ad67-529135dea002 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.272839 Aug 30 01:11:33.383354 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 62/135] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:33 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:33.650056 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2ac0a007-4c95-4d63-9165-8d91e6558658 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:33.650576 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2ac0a007-4c95-4d63-9165-8d91e6558658 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:33.657080 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ac0a007-4c95-4d63-9165-8d91e6558658 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:33.657569 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ac0a007-4c95-4d63-9165-8d91e6558658 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:33.658401 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ac0a007-4c95-4d63-9165-8d91e6558658 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:33.659355 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ac0a007-4c95-4d63-9165-8d91e6558658 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:33.659989 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ac0a007-4c95-4d63-9165-8d91e6558658 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:33.660702 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ac0a007-4c95-4d63-9165-8d91e6558658 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:33.859891 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-342c46f5-b3d0-4b34-bb51-84e5b08d7fa1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:33.859891 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-342c46f5-b3d0-4b34-bb51-84e5b08d7fa1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:33.867010 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-342c46f5-b3d0-4b34-bb51-84e5b08d7fa1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:33.867510 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-342c46f5-b3d0-4b34-bb51-84e5b08d7fa1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:33.868007 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-342c46f5-b3d0-4b34-bb51-84e5b08d7fa1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:33.868727 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-342c46f5-b3d0-4b34-bb51-84e5b08d7fa1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:33.869182 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-342c46f5-b3d0-4b34-bb51-84e5b08d7fa1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:33.869829 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-342c46f5-b3d0-4b34-bb51-84e5b08d7fa1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:34.120039 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2ac0a007-4c95-4d63-9165-8d91e6558658 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:34.120039 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2ac0a007-4c95-4d63-9165-8d91e6558658 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.467045 Aug 30 01:11:34.123813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 74/136] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:33 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:34.137256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a31a9129-efae-4318-b76b-f205517800e2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:34.140507 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a31a9129-efae-4318-b76b-f205517800e2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:34.150527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=100 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:34.160762 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a31a9129-efae-4318-b76b-f205517800e2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:34.162652 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a31a9129-efae-4318-b76b-f205517800e2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:34.163383 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a31a9129-efae-4318-b76b-f205517800e2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:34.166685 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a31a9129-efae-4318-b76b-f205517800e2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:34.167415 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a31a9129-efae-4318-b76b-f205517800e2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:34.168151 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a31a9129-efae-4318-b76b-f205517800e2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:34.552866 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-342c46f5-b3d0-4b34-bb51-84e5b08d7fa1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:34.560962 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-342c46f5-b3d0-4b34-bb51-84e5b08d7fa1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.707909 Aug 30 01:11:34.573876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 63/137] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:33 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:34.577356 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-725c3af3-1319-45fc-8961-5840137a249f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:34.578006 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-725c3af3-1319-45fc-8961-5840137a249f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:34.590828 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-725c3af3-1319-45fc-8961-5840137a249f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:34.591420 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-725c3af3-1319-45fc-8961-5840137a249f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:34.591863 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-725c3af3-1319-45fc-8961-5840137a249f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:34.592667 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-725c3af3-1319-45fc-8961-5840137a249f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:34.593130 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-725c3af3-1319-45fc-8961-5840137a249f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:34.598026 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-725c3af3-1319-45fc-8961-5840137a249f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:34.739569 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a31a9129-efae-4318-b76b-f205517800e2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:34.750052 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a31a9129-efae-4318-b76b-f205517800e2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:34.751429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a31a9129-efae-4318-b76b-f205517800e2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:34.752746 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a31a9129-efae-4318-b76b-f205517800e2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.629332 Aug 30 01:11:34.753934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 75/138] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:34 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:34.769849 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5ba595c5-f1ba-4014-ab1b-414986901d9d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:34.770927 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5ba595c5-f1ba-4014-ab1b-414986901d9d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:34.782074 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5ba595c5-f1ba-4014-ab1b-414986901d9d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:34.783969 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5ba595c5-f1ba-4014-ab1b-414986901d9d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:34.784621 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5ba595c5-f1ba-4014-ab1b-414986901d9d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:34.785607 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5ba595c5-f1ba-4014-ab1b-414986901d9d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:34.786287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5ba595c5-f1ba-4014-ab1b-414986901d9d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:34.786915 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5ba595c5-f1ba-4014-ab1b-414986901d9d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:35.040798 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5ba595c5-f1ba-4014-ab1b-414986901d9d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:35.049611 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5ba595c5-f1ba-4014-ab1b-414986901d9d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.294482 Aug 30 01:11:35.050232 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 76/139] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:34 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:35.058533 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-725c3af3-1319-45fc-8961-5840137a249f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:35.068380 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-725c3af3-1319-45fc-8961-5840137a249f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.495638 Aug 30 01:11:35.068942 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 64/140] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:34 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:35.141583 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-69c1d73d-5c83-49f4-8f27-7468a413ac7d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:35.142225 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-69c1d73d-5c83-49f4-8f27-7468a413ac7d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:35.148703 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69c1d73d-5c83-49f4-8f27-7468a413ac7d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:35.149150 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69c1d73d-5c83-49f4-8f27-7468a413ac7d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:35.149590 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69c1d73d-5c83-49f4-8f27-7468a413ac7d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:35.150319 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69c1d73d-5c83-49f4-8f27-7468a413ac7d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:35.150774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69c1d73d-5c83-49f4-8f27-7468a413ac7d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:35.151197 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69c1d73d-5c83-49f4-8f27-7468a413ac7d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:35.298732 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-69c1d73d-5c83-49f4-8f27-7468a413ac7d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:35.306523 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-69c1d73d-5c83-49f4-8f27-7468a413ac7d tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.169533 Aug 30 01:11:35.307369 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 77/141] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:35 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:35.580596 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ee0e700c-70f2-4b92-8140-ccb90924f460 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:35.581435 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ee0e700c-70f2-4b92-8140-ccb90924f460 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:35.587624 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ee0e700c-70f2-4b92-8140-ccb90924f460 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:35.588110 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ee0e700c-70f2-4b92-8140-ccb90924f460 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:35.588753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ee0e700c-70f2-4b92-8140-ccb90924f460 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:35.589449 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ee0e700c-70f2-4b92-8140-ccb90924f460 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:35.590005 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ee0e700c-70f2-4b92-8140-ccb90924f460 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:35.592612 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ee0e700c-70f2-4b92-8140-ccb90924f460 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:35.713236 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-c33bc31c-ef82-421e-b14c-6b2089c03bd5 req-bf3b14b7-2bea-4486-b2bb-fb8be2171de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4475905-983f-47fb-8b8e-6c87baeac22d", "tag": "3efaeb1f-3500-4863-b27f-c56c1aa2946c"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:35.723704 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-c33bc31c-ef82-421e-b14c-6b2089c03bd5 req-bf3b14b7-2bea-4486-b2bb-fb8be2171de1 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:35.724202 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-c33bc31c-ef82-421e-b14c-6b2089c03bd5 req-bf3b14b7-2bea-4486-b2bb-fb8be2171de1 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:35.724619 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-c33bc31c-ef82-421e-b14c-6b2089c03bd5 req-bf3b14b7-2bea-4486-b2bb-fb8be2171de1 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:35.737811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-c33bc31c-ef82-421e-b14c-6b2089c03bd5 req-bf3b14b7-2bea-4486-b2bb-fb8be2171de1 service nova] Creating event network-changed:3efaeb1f-3500-4863-b27f-c56c1aa2946c for instance d4475905-983f-47fb-8b8e-6c87baeac22d on hv-cinder-81571 Aug 30 01:11:35.745695 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-c33bc31c-ef82-421e-b14c-6b2089c03bd5 req-bf3b14b7-2bea-4486-b2bb-fb8be2171de1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036696 Aug 30 01:11:35.749325 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 78/142] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:11:35.775580 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ec010d56-4c29-424a-b550-109a90096318 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:35.776515 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ec010d56-4c29-424a-b550-109a90096318 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:35.786400 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec010d56-4c29-424a-b550-109a90096318 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:35.787028 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec010d56-4c29-424a-b550-109a90096318 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:35.787471 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec010d56-4c29-424a-b550-109a90096318 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:35.799070 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec010d56-4c29-424a-b550-109a90096318 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:35.805909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec010d56-4c29-424a-b550-109a90096318 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:35.805909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec010d56-4c29-424a-b550-109a90096318 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:35.824479 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ee0e700c-70f2-4b92-8140-ccb90924f460 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:35.834882 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ee0e700c-70f2-4b92-8140-ccb90924f460 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.258007 Aug 30 01:11:35.838410 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 65/143] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:35 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:35.971764 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ec010d56-4c29-424a-b550-109a90096318 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:35.986206 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ec010d56-4c29-424a-b550-109a90096318 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:35.990975 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ec010d56-4c29-424a-b550-109a90096318 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:35.992192 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ec010d56-4c29-424a-b550-109a90096318 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.220881 Aug 30 01:11:35.994258 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 79/144] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:35 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:11:36.072421 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-abe4a7cb-6300-4a34-b24c-67441e93493f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:36.078726 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-abe4a7cb-6300-4a34-b24c-67441e93493f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:36.079932 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-abe4a7cb-6300-4a34-b24c-67441e93493f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:36.081019 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-abe4a7cb-6300-4a34-b24c-67441e93493f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:36.081470 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-abe4a7cb-6300-4a34-b24c-67441e93493f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:36.082230 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-abe4a7cb-6300-4a34-b24c-67441e93493f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:36.082684 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-abe4a7cb-6300-4a34-b24c-67441e93493f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:36.083277 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-abe4a7cb-6300-4a34-b24c-67441e93493f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:36.088968 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2c1a9647-f063-4360-b60e-bf8330bb8267 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:36.089712 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2c1a9647-f063-4360-b60e-bf8330bb8267 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:36.113094 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2c1a9647-f063-4360-b60e-bf8330bb8267 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:36.113094 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2c1a9647-f063-4360-b60e-bf8330bb8267 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:36.113094 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2c1a9647-f063-4360-b60e-bf8330bb8267 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:36.113094 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2c1a9647-f063-4360-b60e-bf8330bb8267 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:36.113586 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2c1a9647-f063-4360-b60e-bf8330bb8267 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:36.114685 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2c1a9647-f063-4360-b60e-bf8330bb8267 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:36.310247 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-abe4a7cb-6300-4a34-b24c-67441e93493f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:36.319603 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-abe4a7cb-6300-4a34-b24c-67441e93493f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.251772 Aug 30 01:11:36.323060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 66/145] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:36 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:36.339928 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fe6a24c0-77f7-4ecc-9480-0fa39491e550 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:36.345654 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fe6a24c0-77f7-4ecc-9480-0fa39491e550 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:36.362371 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe6a24c0-77f7-4ecc-9480-0fa39491e550 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:36.362371 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe6a24c0-77f7-4ecc-9480-0fa39491e550 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:36.362371 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe6a24c0-77f7-4ecc-9480-0fa39491e550 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:36.362977 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2c1a9647-f063-4360-b60e-bf8330bb8267 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:36.363105 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe6a24c0-77f7-4ecc-9480-0fa39491e550 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:36.363430 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe6a24c0-77f7-4ecc-9480-0fa39491e550 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:36.363874 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe6a24c0-77f7-4ecc-9480-0fa39491e550 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:36.368871 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2c1a9647-f063-4360-b60e-bf8330bb8267 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.283857 Aug 30 01:11:36.375113 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 80/146] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:36 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:36.555586 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fe6a24c0-77f7-4ecc-9480-0fa39491e550 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:36.564507 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fe6a24c0-77f7-4ecc-9480-0fa39491e550 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.235344 Aug 30 01:11:36.566005 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 67/147] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:36 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:36.857073 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-42283d5b-9d91-4d3c-8c31-f296da268a50 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:36.857679 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-42283d5b-9d91-4d3c-8c31-f296da268a50 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:36.863658 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-42283d5b-9d91-4d3c-8c31-f296da268a50 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:36.864972 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-42283d5b-9d91-4d3c-8c31-f296da268a50 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:36.864972 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-42283d5b-9d91-4d3c-8c31-f296da268a50 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:36.865321 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-42283d5b-9d91-4d3c-8c31-f296da268a50 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:36.865806 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-42283d5b-9d91-4d3c-8c31-f296da268a50 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:36.866235 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-42283d5b-9d91-4d3c-8c31-f296da268a50 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:37.016431 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-afb61b5c-a1e3-411f-abb8-1e30f747033e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:37.017055 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-afb61b5c-a1e3-411f-abb8-1e30f747033e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:37.027115 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afb61b5c-a1e3-411f-abb8-1e30f747033e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:37.028458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afb61b5c-a1e3-411f-abb8-1e30f747033e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:37.029558 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afb61b5c-a1e3-411f-abb8-1e30f747033e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:37.033389 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afb61b5c-a1e3-411f-abb8-1e30f747033e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:37.034917 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afb61b5c-a1e3-411f-abb8-1e30f747033e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:37.036188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afb61b5c-a1e3-411f-abb8-1e30f747033e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:37.116553 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-42283d5b-9d91-4d3c-8c31-f296da268a50 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:37.124367 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-42283d5b-9d91-4d3c-8c31-f296da268a50 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.271250 Aug 30 01:11:37.124957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 81/148] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:36 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:37.264019 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-afb61b5c-a1e3-411f-abb8-1e30f747033e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:37.272277 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-afb61b5c-a1e3-411f-abb8-1e30f747033e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:37.273753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-afb61b5c-a1e3-411f-abb8-1e30f747033e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:37.274863 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-afb61b5c-a1e3-411f-abb8-1e30f747033e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.262465 Aug 30 01:11:37.275426 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 68/149] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:37 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:11:37.343953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-dcd605d6-2cb0-4d74-8fe2-6b624c46ce99 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:37.344823 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-dcd605d6-2cb0-4d74-8fe2-6b624c46ce99 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:37.350846 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dcd605d6-2cb0-4d74-8fe2-6b624c46ce99 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:37.351529 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dcd605d6-2cb0-4d74-8fe2-6b624c46ce99 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:37.351976 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dcd605d6-2cb0-4d74-8fe2-6b624c46ce99 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:37.352667 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dcd605d6-2cb0-4d74-8fe2-6b624c46ce99 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:37.353120 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dcd605d6-2cb0-4d74-8fe2-6b624c46ce99 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:37.353586 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dcd605d6-2cb0-4d74-8fe2-6b624c46ce99 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:37.395417 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b8d7e6bb-2536-49bc-a334-bd65b71abd30 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:37.396028 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b8d7e6bb-2536-49bc-a334-bd65b71abd30 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:37.402397 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b8d7e6bb-2536-49bc-a334-bd65b71abd30 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:37.402952 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b8d7e6bb-2536-49bc-a334-bd65b71abd30 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:37.403454 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b8d7e6bb-2536-49bc-a334-bd65b71abd30 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:37.404225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b8d7e6bb-2536-49bc-a334-bd65b71abd30 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:37.404788 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b8d7e6bb-2536-49bc-a334-bd65b71abd30 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:37.405272 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b8d7e6bb-2536-49bc-a334-bd65b71abd30 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:37.504124 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-dcd605d6-2cb0-4d74-8fe2-6b624c46ce99 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:37.508163 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=100 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:37.512743 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-dcd605d6-2cb0-4d74-8fe2-6b624c46ce99 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.173782 Aug 30 01:11:37.521914 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 82/150] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:37 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:37.573707 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b8d7e6bb-2536-49bc-a334-bd65b71abd30 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:37.582486 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b8d7e6bb-2536-49bc-a334-bd65b71abd30 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.197397 Aug 30 01:11:37.583062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 69/151] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:37 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:37.599337 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f0b5bfeb-d1d0-48bf-927e-36170a54997f tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:37.599337 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f0b5bfeb-d1d0-48bf-927e-36170a54997f tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:37.604665 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0b5bfeb-d1d0-48bf-927e-36170a54997f tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:37.605137 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0b5bfeb-d1d0-48bf-927e-36170a54997f tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:37.605605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0b5bfeb-d1d0-48bf-927e-36170a54997f tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:37.606398 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0b5bfeb-d1d0-48bf-927e-36170a54997f tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:37.607675 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0b5bfeb-d1d0-48bf-927e-36170a54997f tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:37.607675 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0b5bfeb-d1d0-48bf-927e-36170a54997f tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:37.745230 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f0b5bfeb-d1d0-48bf-927e-36170a54997f tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:37.753564 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f0b5bfeb-d1d0-48bf-927e-36170a54997f tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.159855 Aug 30 01:11:37.754994 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 83/152] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:37 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:38.146595 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a9278e6f-636e-49a0-9b02-1d1607e6725b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:38.147231 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a9278e6f-636e-49a0-9b02-1d1607e6725b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:38.154142 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a9278e6f-636e-49a0-9b02-1d1607e6725b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:38.154831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a9278e6f-636e-49a0-9b02-1d1607e6725b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:38.155269 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a9278e6f-636e-49a0-9b02-1d1607e6725b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:38.156008 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a9278e6f-636e-49a0-9b02-1d1607e6725b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:38.156461 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a9278e6f-636e-49a0-9b02-1d1607e6725b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:38.157597 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a9278e6f-636e-49a0-9b02-1d1607e6725b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:38.300093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2eeba00e-dce5-47a5-a83c-29be40cda75e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:38.300713 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2eeba00e-dce5-47a5-a83c-29be40cda75e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:38.307065 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2eeba00e-dce5-47a5-a83c-29be40cda75e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:38.307558 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2eeba00e-dce5-47a5-a83c-29be40cda75e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:38.307993 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2eeba00e-dce5-47a5-a83c-29be40cda75e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:38.308698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2eeba00e-dce5-47a5-a83c-29be40cda75e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:38.309153 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2eeba00e-dce5-47a5-a83c-29be40cda75e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:38.309578 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2eeba00e-dce5-47a5-a83c-29be40cda75e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:38.453760 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2eeba00e-dce5-47a5-a83c-29be40cda75e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:38.462669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2eeba00e-dce5-47a5-a83c-29be40cda75e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:38.463437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2eeba00e-dce5-47a5-a83c-29be40cda75e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:38.464596 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2eeba00e-dce5-47a5-a83c-29be40cda75e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.168730 Aug 30 01:11:38.465354 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 84/153] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:38 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:11:38.488299 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a9278e6f-636e-49a0-9b02-1d1607e6725b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:38.496472 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a9278e6f-636e-49a0-9b02-1d1607e6725b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.353558 Aug 30 01:11:38.497249 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 70/154] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:38 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:38.535065 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4e13d843-eb65-4cef-a8a4-7906d5a83e57 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:38.535806 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4e13d843-eb65-4cef-a8a4-7906d5a83e57 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:38.543987 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4e13d843-eb65-4cef-a8a4-7906d5a83e57 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:38.544853 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4e13d843-eb65-4cef-a8a4-7906d5a83e57 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:38.545530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4e13d843-eb65-4cef-a8a4-7906d5a83e57 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:38.546766 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4e13d843-eb65-4cef-a8a4-7906d5a83e57 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:38.547471 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4e13d843-eb65-4cef-a8a4-7906d5a83e57 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:38.548500 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4e13d843-eb65-4cef-a8a4-7906d5a83e57 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:38.604409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f04746f7-1ebb-4fb3-90e9-4128c13a24bd tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:38.605013 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f04746f7-1ebb-4fb3-90e9-4128c13a24bd tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:38.611802 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f04746f7-1ebb-4fb3-90e9-4128c13a24bd tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:38.612323 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f04746f7-1ebb-4fb3-90e9-4128c13a24bd tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:38.612793 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f04746f7-1ebb-4fb3-90e9-4128c13a24bd tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:38.613586 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f04746f7-1ebb-4fb3-90e9-4128c13a24bd tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:38.614076 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f04746f7-1ebb-4fb3-90e9-4128c13a24bd tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:38.614530 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f04746f7-1ebb-4fb3-90e9-4128c13a24bd tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:38.685897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4e13d843-eb65-4cef-a8a4-7906d5a83e57 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:38.693659 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4e13d843-eb65-4cef-a8a4-7906d5a83e57 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.162416 Aug 30 01:11:38.694434 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 85/155] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:38 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:38.752346 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f04746f7-1ebb-4fb3-90e9-4128c13a24bd tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:38.760362 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f04746f7-1ebb-4fb3-90e9-4128c13a24bd tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.159744 Aug 30 01:11:38.760949 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 71/156] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:38 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:38.779208 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-85543a4b-5e71-4dff-9cc0-f3a32471180c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:38.780885 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-85543a4b-5e71-4dff-9cc0-f3a32471180c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:38.786697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-85543a4b-5e71-4dff-9cc0-f3a32471180c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:38.787274 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-85543a4b-5e71-4dff-9cc0-f3a32471180c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:38.787715 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-85543a4b-5e71-4dff-9cc0-f3a32471180c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:38.788417 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-85543a4b-5e71-4dff-9cc0-f3a32471180c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:38.788873 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-85543a4b-5e71-4dff-9cc0-f3a32471180c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:38.789302 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-85543a4b-5e71-4dff-9cc0-f3a32471180c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:38.925334 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-85543a4b-5e71-4dff-9cc0-f3a32471180c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:38.933155 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-85543a4b-5e71-4dff-9cc0-f3a32471180c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.161534 Aug 30 01:11:38.933796 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 86/157] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:38 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:39.486664 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-345921b2-ef1a-4857-bbef-99b242689fb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:39.487271 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-345921b2-ef1a-4857-bbef-99b242689fb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:39.493362 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-345921b2-ef1a-4857-bbef-99b242689fb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:39.493893 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-345921b2-ef1a-4857-bbef-99b242689fb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:39.494320 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-345921b2-ef1a-4857-bbef-99b242689fb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:39.495035 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-345921b2-ef1a-4857-bbef-99b242689fb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:39.495490 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-345921b2-ef1a-4857-bbef-99b242689fb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:39.495913 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-345921b2-ef1a-4857-bbef-99b242689fb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:39.526053 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-de0c7e24-5085-4b7d-8490-0b4e2b5a420c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:39.526592 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-de0c7e24-5085-4b7d-8490-0b4e2b5a420c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:39.533602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-de0c7e24-5085-4b7d-8490-0b4e2b5a420c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:39.534126 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-de0c7e24-5085-4b7d-8490-0b4e2b5a420c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:39.534565 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-de0c7e24-5085-4b7d-8490-0b4e2b5a420c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:39.535267 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-de0c7e24-5085-4b7d-8490-0b4e2b5a420c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:39.535723 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-de0c7e24-5085-4b7d-8490-0b4e2b5a420c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:39.536150 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-de0c7e24-5085-4b7d-8490-0b4e2b5a420c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:39.632575 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-345921b2-ef1a-4857-bbef-99b242689fb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:39.646892 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-345921b2-ef1a-4857-bbef-99b242689fb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:39.648748 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-345921b2-ef1a-4857-bbef-99b242689fb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:39.650086 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-345921b2-ef1a-4857-bbef-99b242689fb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.167290 Aug 30 01:11:39.651007 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 72/158] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:39 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:39.680531 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-de0c7e24-5085-4b7d-8490-0b4e2b5a420c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:39.689096 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-de0c7e24-5085-4b7d-8490-0b4e2b5a420c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.167252 Aug 30 01:11:39.689673 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 87/159] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:39 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:39.716152 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ae1472cb-c121-4fe0-b5e2-f03d288e5975 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:39.717642 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ae1472cb-c121-4fe0-b5e2-f03d288e5975 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:39.723833 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae1472cb-c121-4fe0-b5e2-f03d288e5975 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:39.724345 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae1472cb-c121-4fe0-b5e2-f03d288e5975 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:39.727084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae1472cb-c121-4fe0-b5e2-f03d288e5975 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:39.727084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae1472cb-c121-4fe0-b5e2-f03d288e5975 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:39.727084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae1472cb-c121-4fe0-b5e2-f03d288e5975 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:39.727084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae1472cb-c121-4fe0-b5e2-f03d288e5975 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:39.782039 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ca0544b3-1824-4f47-993c-2cb1c0ed4179 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:39.782519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ca0544b3-1824-4f47-993c-2cb1c0ed4179 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:39.784406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=2 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:39.789827 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ca0544b3-1824-4f47-993c-2cb1c0ed4179 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:39.790316 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ca0544b3-1824-4f47-993c-2cb1c0ed4179 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:39.790750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ca0544b3-1824-4f47-993c-2cb1c0ed4179 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:39.791448 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ca0544b3-1824-4f47-993c-2cb1c0ed4179 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:39.791879 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ca0544b3-1824-4f47-993c-2cb1c0ed4179 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:39.792302 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ca0544b3-1824-4f47-993c-2cb1c0ed4179 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:39.870998 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ae1472cb-c121-4fe0-b5e2-f03d288e5975 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:39.879968 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ae1472cb-c121-4fe0-b5e2-f03d288e5975 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.167720 Aug 30 01:11:39.880552 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 73/160] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:39 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:39.942903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ca0544b3-1824-4f47-993c-2cb1c0ed4179 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:39.952854 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ca0544b3-1824-4f47-993c-2cb1c0ed4179 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.174766 Aug 30 01:11:39.953647 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 88/161] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:39 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:39.955001 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5536d526-1071-4f5b-9d6b-aea136d8a552 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:39.955611 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5536d526-1071-4f5b-9d6b-aea136d8a552 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:39.962836 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5536d526-1071-4f5b-9d6b-aea136d8a552 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:39.963317 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5536d526-1071-4f5b-9d6b-aea136d8a552 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:39.963745 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5536d526-1071-4f5b-9d6b-aea136d8a552 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:39.964436 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5536d526-1071-4f5b-9d6b-aea136d8a552 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:39.964874 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5536d526-1071-4f5b-9d6b-aea136d8a552 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:39.965290 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5536d526-1071-4f5b-9d6b-aea136d8a552 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:40.110595 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5536d526-1071-4f5b-9d6b-aea136d8a552 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:40.118346 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5536d526-1071-4f5b-9d6b-aea136d8a552 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.167653 Aug 30 01:11:40.119135 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 74/162] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:39 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:40.463172 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-b207884a-310c-4564-ac4f-a47d59f1e70f req-c7e93ce7-ca5f-42c5-9c86-e3393b1f4a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1388d14-c15e-4f95-9b68-944001f0d53a", "name": "network-vif-plugged", "status": "completed", "tag": "531e11a0-79a8-4242-9108-a01eaf852ae3"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:40.473938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-b207884a-310c-4564-ac4f-a47d59f1e70f req-c7e93ce7-ca5f-42c5-9c86-e3393b1f4a6c service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:40.474442 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-b207884a-310c-4564-ac4f-a47d59f1e70f req-c7e93ce7-ca5f-42c5-9c86-e3393b1f4a6c service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:40.474872 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-b207884a-310c-4564-ac4f-a47d59f1e70f req-c7e93ce7-ca5f-42c5-9c86-e3393b1f4a6c service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:40.487405 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-b207884a-310c-4564-ac4f-a47d59f1e70f req-c7e93ce7-ca5f-42c5-9c86-e3393b1f4a6c service nova] Creating event network-vif-plugged:531e11a0-79a8-4242-9108-a01eaf852ae3 for instance e1388d14-c15e-4f95-9b68-944001f0d53a on hv-cinder-81571 Aug 30 01:11:40.493467 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-b207884a-310c-4564-ac4f-a47d59f1e70f req-c7e93ce7-ca5f-42c5-9c86-e3393b1f4a6c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089959 Aug 30 01:11:40.494315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 89/163] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:40.673165 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b0005248-a2f9-492a-a5b0-440751a661aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:40.674326 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b0005248-a2f9-492a-a5b0-440751a661aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:40.680952 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0005248-a2f9-492a-a5b0-440751a661aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:40.681518 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0005248-a2f9-492a-a5b0-440751a661aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:40.682359 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0005248-a2f9-492a-a5b0-440751a661aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:40.683006 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0005248-a2f9-492a-a5b0-440751a661aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:40.683661 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0005248-a2f9-492a-a5b0-440751a661aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:40.684127 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0005248-a2f9-492a-a5b0-440751a661aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:40.712632 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d051a358-bf60-4d7d-a073-7b4a694df96c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:40.713372 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d051a358-bf60-4d7d-a073-7b4a694df96c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:40.721807 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d051a358-bf60-4d7d-a073-7b4a694df96c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:40.722537 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d051a358-bf60-4d7d-a073-7b4a694df96c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:40.723104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d051a358-bf60-4d7d-a073-7b4a694df96c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:40.726257 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d051a358-bf60-4d7d-a073-7b4a694df96c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:40.726257 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d051a358-bf60-4d7d-a073-7b4a694df96c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:40.726257 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d051a358-bf60-4d7d-a073-7b4a694df96c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:40.941809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d051a358-bf60-4d7d-a073-7b4a694df96c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:40.950944 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d051a358-bf60-4d7d-a073-7b4a694df96c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.243301 Aug 30 01:11:40.951881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 90/164] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:40 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:40.956697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0029c306-33ab-48b4-8e58-b7f6e4f0c13e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:40.957300 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0029c306-33ab-48b4-8e58-b7f6e4f0c13e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:40.971620 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0029c306-33ab-48b4-8e58-b7f6e4f0c13e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:40.972191 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0029c306-33ab-48b4-8e58-b7f6e4f0c13e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:40.972815 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0029c306-33ab-48b4-8e58-b7f6e4f0c13e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:40.973526 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0029c306-33ab-48b4-8e58-b7f6e4f0c13e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:40.974016 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0029c306-33ab-48b4-8e58-b7f6e4f0c13e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:40.977591 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0029c306-33ab-48b4-8e58-b7f6e4f0c13e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:41.127470 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b0005248-a2f9-492a-a5b0-440751a661aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:41.148152 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b0005248-a2f9-492a-a5b0-440751a661aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:41.153353 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b0005248-a2f9-492a-a5b0-440751a661aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:41.161219 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b0005248-a2f9-492a-a5b0-440751a661aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.487115 Aug 30 01:11:41.161219 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 75/165] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:40 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:41.167678 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0029c306-33ab-48b4-8e58-b7f6e4f0c13e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:41.174372 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ddc71e0d-22bf-40d6-ab7d-1402706e4851 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:41.175336 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ddc71e0d-22bf-40d6-ab7d-1402706e4851 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:41.182172 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddc71e0d-22bf-40d6-ab7d-1402706e4851 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:41.183115 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0029c306-33ab-48b4-8e58-b7f6e4f0c13e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.229888 Aug 30 01:11:41.183714 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 91/166] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:40 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:41.187751 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddc71e0d-22bf-40d6-ab7d-1402706e4851 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:41.188418 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddc71e0d-22bf-40d6-ab7d-1402706e4851 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:41.189515 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddc71e0d-22bf-40d6-ab7d-1402706e4851 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:41.190802 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddc71e0d-22bf-40d6-ab7d-1402706e4851 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:41.193114 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddc71e0d-22bf-40d6-ab7d-1402706e4851 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:41.194785 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ed241de7-080c-4a00-8176-1cb96eef87e9 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:41.197914 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ed241de7-080c-4a00-8176-1cb96eef87e9 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:41.206743 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ed241de7-080c-4a00-8176-1cb96eef87e9 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:41.207227 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ed241de7-080c-4a00-8176-1cb96eef87e9 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:41.207694 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ed241de7-080c-4a00-8176-1cb96eef87e9 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:41.208398 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ed241de7-080c-4a00-8176-1cb96eef87e9 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:41.208905 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ed241de7-080c-4a00-8176-1cb96eef87e9 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:41.210045 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ed241de7-080c-4a00-8176-1cb96eef87e9 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:41.542233 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ed241de7-080c-4a00-8176-1cb96eef87e9 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:41.552999 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ed241de7-080c-4a00-8176-1cb96eef87e9 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.368177 Aug 30 01:11:41.553695 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 92/167] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:41 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:41.674434 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ddc71e0d-22bf-40d6-ab7d-1402706e4851 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:41.699214 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ddc71e0d-22bf-40d6-ab7d-1402706e4851 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.532548 Aug 30 01:11:41.702359 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 76/168] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:41 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:41.971869 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-aa40062f-9c21-439d-9c25-20825b34e445 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:41.973007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-aa40062f-9c21-439d-9c25-20825b34e445 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:41.980248 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aa40062f-9c21-439d-9c25-20825b34e445 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:41.981257 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aa40062f-9c21-439d-9c25-20825b34e445 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:41.982593 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aa40062f-9c21-439d-9c25-20825b34e445 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:41.983605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aa40062f-9c21-439d-9c25-20825b34e445 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:41.984251 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aa40062f-9c21-439d-9c25-20825b34e445 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:41.984837 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aa40062f-9c21-439d-9c25-20825b34e445 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:42.170345 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-aa40062f-9c21-439d-9c25-20825b34e445 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:42.179160 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-aa40062f-9c21-439d-9c25-20825b34e445 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.211156 Aug 30 01:11:42.187222 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-71a5757e-7c05-462a-94ec-744b6f6adbf9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:42.188157 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-71a5757e-7c05-462a-94ec-744b6f6adbf9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:42.192648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 93/169] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:41 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:42.199705 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71a5757e-7c05-462a-94ec-744b6f6adbf9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:42.201229 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71a5757e-7c05-462a-94ec-744b6f6adbf9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:42.208751 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71a5757e-7c05-462a-94ec-744b6f6adbf9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:42.209539 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71a5757e-7c05-462a-94ec-744b6f6adbf9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:42.210030 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71a5757e-7c05-462a-94ec-744b6f6adbf9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:42.210595 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a251c0ae-2fbb-42c1-b549-244a4960ddf9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:42.211217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a251c0ae-2fbb-42c1-b549-244a4960ddf9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:42.212689 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71a5757e-7c05-462a-94ec-744b6f6adbf9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:42.232970 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a251c0ae-2fbb-42c1-b549-244a4960ddf9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:42.233517 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a251c0ae-2fbb-42c1-b549-244a4960ddf9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:42.233993 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a251c0ae-2fbb-42c1-b549-244a4960ddf9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:42.234717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a251c0ae-2fbb-42c1-b549-244a4960ddf9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:42.235161 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a251c0ae-2fbb-42c1-b549-244a4960ddf9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:42.235935 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a251c0ae-2fbb-42c1-b549-244a4960ddf9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:42.385680 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-71a5757e-7c05-462a-94ec-744b6f6adbf9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:42.398206 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-71a5757e-7c05-462a-94ec-744b6f6adbf9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:42.400116 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-71a5757e-7c05-462a-94ec-744b6f6adbf9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:42.401600 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-71a5757e-7c05-462a-94ec-744b6f6adbf9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.219613 Aug 30 01:11:42.402727 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 77/170] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:42 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:42.436166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a251c0ae-2fbb-42c1-b549-244a4960ddf9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:42.444894 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a251c0ae-2fbb-42c1-b549-244a4960ddf9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.242075 Aug 30 01:11:42.455955 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 94/171] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:42 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:42.522057 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-ce614026-a2df-41b0-aca4-c32cc663ce78 req-6f1ec419-a4a1-4bd3-9348-2c00f94542a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30841f5c-b634-47dc-97ab-c651bf3ace8a", "name": "network-vif-plugged", "status": "completed", "tag": "d8d36366-3bec-4323-a577-34ce2e4beafd"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:42.525378 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ce614026-a2df-41b0-aca4-c32cc663ce78 req-6f1ec419-a4a1-4bd3-9348-2c00f94542a1 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:42.525925 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ce614026-a2df-41b0-aca4-c32cc663ce78 req-6f1ec419-a4a1-4bd3-9348-2c00f94542a1 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:42.526580 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ce614026-a2df-41b0-aca4-c32cc663ce78 req-6f1ec419-a4a1-4bd3-9348-2c00f94542a1 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:42.541761 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-ce614026-a2df-41b0-aca4-c32cc663ce78 req-6f1ec419-a4a1-4bd3-9348-2c00f94542a1 service nova] Creating event network-vif-plugged:d8d36366-3bec-4323-a577-34ce2e4beafd for instance 30841f5c-b634-47dc-97ab-c651bf3ace8a on hv-cinder-81571 Aug 30 01:11:42.549412 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-ce614026-a2df-41b0-aca4-c32cc663ce78 req-6f1ec419-a4a1-4bd3-9348-2c00f94542a1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038752 Aug 30 01:11:42.550230 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 78/172] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:11:42.576239 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-3ec05525-4684-42a8-a30f-60e7bce6d21b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:42.579103 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-3ec05525-4684-42a8-a30f-60e7bce6d21b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:42.584086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3ec05525-4684-42a8-a30f-60e7bce6d21b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:42.584086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3ec05525-4684-42a8-a30f-60e7bce6d21b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:42.584086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3ec05525-4684-42a8-a30f-60e7bce6d21b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:42.584821 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3ec05525-4684-42a8-a30f-60e7bce6d21b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:42.585268 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3ec05525-4684-42a8-a30f-60e7bce6d21b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:42.585688 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3ec05525-4684-42a8-a30f-60e7bce6d21b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:42.719038 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-3ec05525-4684-42a8-a30f-60e7bce6d21b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:42.723501 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-71fdea05-5d77-46e5-ae40-59d9b2ba7059 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:42.724209 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-71fdea05-5d77-46e5-ae40-59d9b2ba7059 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:42.727386 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-3ec05525-4684-42a8-a30f-60e7bce6d21b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.155829 Aug 30 01:11:42.728634 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 95/173] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:42 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:42.732286 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71fdea05-5d77-46e5-ae40-59d9b2ba7059 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:42.732286 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71fdea05-5d77-46e5-ae40-59d9b2ba7059 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:42.732654 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71fdea05-5d77-46e5-ae40-59d9b2ba7059 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:42.733534 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71fdea05-5d77-46e5-ae40-59d9b2ba7059 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:42.734052 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71fdea05-5d77-46e5-ae40-59d9b2ba7059 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:42.734476 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71fdea05-5d77-46e5-ae40-59d9b2ba7059 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:42.878956 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-71fdea05-5d77-46e5-ae40-59d9b2ba7059 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:42.887146 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-71fdea05-5d77-46e5-ae40-59d9b2ba7059 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.167945 Aug 30 01:11:42.888425 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 79/174] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:42 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:43.203692 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2f911e18-1595-4414-8d3c-464c4042008d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:43.204602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2f911e18-1595-4414-8d3c-464c4042008d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:43.222077 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2f911e18-1595-4414-8d3c-464c4042008d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:43.222660 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2f911e18-1595-4414-8d3c-464c4042008d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:43.223102 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2f911e18-1595-4414-8d3c-464c4042008d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:43.223867 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2f911e18-1595-4414-8d3c-464c4042008d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:43.224337 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2f911e18-1595-4414-8d3c-464c4042008d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:43.224765 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2f911e18-1595-4414-8d3c-464c4042008d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:43.380477 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2f911e18-1595-4414-8d3c-464c4042008d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:43.390981 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2f911e18-1595-4414-8d3c-464c4042008d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.194098 Aug 30 01:11:43.392178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 96/175] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:43 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:43.431779 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-60ff8ecb-b3d1-4616-a013-e64551281f27 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:43.433875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-60ff8ecb-b3d1-4616-a013-e64551281f27 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:43.444686 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60ff8ecb-b3d1-4616-a013-e64551281f27 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:43.445448 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60ff8ecb-b3d1-4616-a013-e64551281f27 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:43.446522 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60ff8ecb-b3d1-4616-a013-e64551281f27 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:43.447763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60ff8ecb-b3d1-4616-a013-e64551281f27 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:43.448744 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60ff8ecb-b3d1-4616-a013-e64551281f27 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:43.450018 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-60ff8ecb-b3d1-4616-a013-e64551281f27 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:43.457814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:43.472403 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-cf4bcd06-f8d9-4410-ae27-927aeb3901c5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:43.474125 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-cf4bcd06-f8d9-4410-ae27-927aeb3901c5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:43.497262 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cf4bcd06-f8d9-4410-ae27-927aeb3901c5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:43.499459 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cf4bcd06-f8d9-4410-ae27-927aeb3901c5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:43.500122 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cf4bcd06-f8d9-4410-ae27-927aeb3901c5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:43.500837 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cf4bcd06-f8d9-4410-ae27-927aeb3901c5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:43.501634 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cf4bcd06-f8d9-4410-ae27-927aeb3901c5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:43.502022 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cf4bcd06-f8d9-4410-ae27-927aeb3901c5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:43.620157 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-60ff8ecb-b3d1-4616-a013-e64551281f27 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:43.629010 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-60ff8ecb-b3d1-4616-a013-e64551281f27 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:43.631103 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-60ff8ecb-b3d1-4616-a013-e64551281f27 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:43.632429 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-60ff8ecb-b3d1-4616-a013-e64551281f27 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.208619 Aug 30 01:11:43.633439 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 80/176] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:43 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:43.667348 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-cf4bcd06-f8d9-4410-ae27-927aeb3901c5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:43.676335 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-cf4bcd06-f8d9-4410-ae27-927aeb3901c5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.212034 Aug 30 01:11:43.677221 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 97/177] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:43 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:43.751017 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3a391b48-a5c5-4cd8-8a94-01bafe7438e5 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:43.751743 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3a391b48-a5c5-4cd8-8a94-01bafe7438e5 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:43.757607 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a391b48-a5c5-4cd8-8a94-01bafe7438e5 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:43.758100 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a391b48-a5c5-4cd8-8a94-01bafe7438e5 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:43.758533 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a391b48-a5c5-4cd8-8a94-01bafe7438e5 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:43.759216 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a391b48-a5c5-4cd8-8a94-01bafe7438e5 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:43.759665 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a391b48-a5c5-4cd8-8a94-01bafe7438e5 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:43.760116 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a391b48-a5c5-4cd8-8a94-01bafe7438e5 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:43.893764 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3a391b48-a5c5-4cd8-8a94-01bafe7438e5 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:43.901638 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3a391b48-a5c5-4cd8-8a94-01bafe7438e5 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.154181 Aug 30 01:11:43.901917 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 81/178] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:43 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:43.909028 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-16032a0d-9b85-458f-9a9b-8eee702665d4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:43.909630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-16032a0d-9b85-458f-9a9b-8eee702665d4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:43.916234 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-16032a0d-9b85-458f-9a9b-8eee702665d4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:43.916731 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-16032a0d-9b85-458f-9a9b-8eee702665d4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:43.917159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-16032a0d-9b85-458f-9a9b-8eee702665d4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:43.917861 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-16032a0d-9b85-458f-9a9b-8eee702665d4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:43.918311 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-16032a0d-9b85-458f-9a9b-8eee702665d4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:43.918728 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-16032a0d-9b85-458f-9a9b-8eee702665d4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:44.064198 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-16032a0d-9b85-458f-9a9b-8eee702665d4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:44.071906 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-16032a0d-9b85-458f-9a9b-8eee702665d4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.166634 Aug 30 01:11:44.072469 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 98/179] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:43 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:44.418254 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e94bdc64-ed02-4d6f-a6c3-9d0054b9d2c5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:44.419157 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e94bdc64-ed02-4d6f-a6c3-9d0054b9d2c5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:44.426075 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e94bdc64-ed02-4d6f-a6c3-9d0054b9d2c5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:44.426589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e94bdc64-ed02-4d6f-a6c3-9d0054b9d2c5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:44.427020 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e94bdc64-ed02-4d6f-a6c3-9d0054b9d2c5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:44.427708 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e94bdc64-ed02-4d6f-a6c3-9d0054b9d2c5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:44.428156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e94bdc64-ed02-4d6f-a6c3-9d0054b9d2c5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:44.428580 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e94bdc64-ed02-4d6f-a6c3-9d0054b9d2c5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:44.563501 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e94bdc64-ed02-4d6f-a6c3-9d0054b9d2c5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:44.571090 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e94bdc64-ed02-4d6f-a6c3-9d0054b9d2c5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.157074 Aug 30 01:11:44.571658 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 82/180] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:44 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:44.656182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c6980348-9d65-469b-a76c-a058f4bd1462 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:44.656708 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c6980348-9d65-469b-a76c-a058f4bd1462 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:44.662704 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c6980348-9d65-469b-a76c-a058f4bd1462 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:44.663177 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c6980348-9d65-469b-a76c-a058f4bd1462 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:44.663604 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c6980348-9d65-469b-a76c-a058f4bd1462 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:44.664277 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c6980348-9d65-469b-a76c-a058f4bd1462 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:44.664728 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c6980348-9d65-469b-a76c-a058f4bd1462 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:44.665141 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c6980348-9d65-469b-a76c-a058f4bd1462 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:44.697065 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-aba5115b-41d0-4daf-8e55-4287841cdd23 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:44.697870 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-aba5115b-41d0-4daf-8e55-4287841cdd23 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:44.713241 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aba5115b-41d0-4daf-8e55-4287841cdd23 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:44.721954 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aba5115b-41d0-4daf-8e55-4287841cdd23 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:44.721954 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aba5115b-41d0-4daf-8e55-4287841cdd23 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:44.721954 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aba5115b-41d0-4daf-8e55-4287841cdd23 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:44.721954 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aba5115b-41d0-4daf-8e55-4287841cdd23 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:44.722373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aba5115b-41d0-4daf-8e55-4287841cdd23 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:44.811305 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c6980348-9d65-469b-a76c-a058f4bd1462 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:44.820551 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c6980348-9d65-469b-a76c-a058f4bd1462 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:44.822137 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c6980348-9d65-469b-a76c-a058f4bd1462 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:44.823375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c6980348-9d65-469b-a76c-a058f4bd1462 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.171807 Aug 30 01:11:44.823925 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 99/181] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:44 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:44.876230 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-aba5115b-41d0-4daf-8e55-4287841cdd23 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:44.883994 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-aba5115b-41d0-4daf-8e55-4287841cdd23 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.190847 Aug 30 01:11:44.884609 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 83/182] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:44 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:44.923795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f1a540ea-f12e-48cb-8dea-186e3211c249 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:44.924319 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f1a540ea-f12e-48cb-8dea-186e3211c249 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:44.930442 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f1a540ea-f12e-48cb-8dea-186e3211c249 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:44.930934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f1a540ea-f12e-48cb-8dea-186e3211c249 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:44.931361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f1a540ea-f12e-48cb-8dea-186e3211c249 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:44.932052 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f1a540ea-f12e-48cb-8dea-186e3211c249 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:44.932502 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f1a540ea-f12e-48cb-8dea-186e3211c249 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:44.932923 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f1a540ea-f12e-48cb-8dea-186e3211c249 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:44.938305 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=100 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:45.078959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f1a540ea-f12e-48cb-8dea-186e3211c249 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:45.087117 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f1a540ea-f12e-48cb-8dea-186e3211c249 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.167812 Aug 30 01:11:45.087680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 100/183] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:44 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:45.120342 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1f7eaa63-f510-46ae-af72-2d50f17d146c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:45.120342 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1f7eaa63-f510-46ae-af72-2d50f17d146c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:45.126796 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f7eaa63-f510-46ae-af72-2d50f17d146c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:45.127514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f7eaa63-f510-46ae-af72-2d50f17d146c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:45.128161 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f7eaa63-f510-46ae-af72-2d50f17d146c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:45.129122 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f7eaa63-f510-46ae-af72-2d50f17d146c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:45.129577 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f7eaa63-f510-46ae-af72-2d50f17d146c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:45.130076 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f7eaa63-f510-46ae-af72-2d50f17d146c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:45.274898 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1f7eaa63-f510-46ae-af72-2d50f17d146c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:45.282844 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1f7eaa63-f510-46ae-af72-2d50f17d146c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.169002 Aug 30 01:11:45.283434 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 84/184] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:45 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:45.445887 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-a664c4cc-01dd-4758-b94a-a720db7e8bc8 req-dbde364d-9e30-4d9c-99dd-290a058ff95e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b016168d-f295-4bb4-9da1-36472ad69576", "name": "network-vif-plugged", "status": "completed", "tag": "beaab680-9f79-4900-9963-851c36bf37f9"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:45.456153 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-a664c4cc-01dd-4758-b94a-a720db7e8bc8 req-dbde364d-9e30-4d9c-99dd-290a058ff95e service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:45.456715 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-a664c4cc-01dd-4758-b94a-a720db7e8bc8 req-dbde364d-9e30-4d9c-99dd-290a058ff95e service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:45.457142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-a664c4cc-01dd-4758-b94a-a720db7e8bc8 req-dbde364d-9e30-4d9c-99dd-290a058ff95e service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:45.469176 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-a664c4cc-01dd-4758-b94a-a720db7e8bc8 req-dbde364d-9e30-4d9c-99dd-290a058ff95e service nova] Creating event network-vif-plugged:beaab680-9f79-4900-9963-851c36bf37f9 for instance b016168d-f295-4bb4-9da1-36472ad69576 on hv-cinder-81571 Aug 30 01:11:45.475072 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-a664c4cc-01dd-4758-b94a-a720db7e8bc8 req-dbde364d-9e30-4d9c-99dd-290a058ff95e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032921 Aug 30 01:11:45.475616 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 101/185] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:45.593482 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9f02d1f1-3c49-4920-aaab-9bdde93856dd tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:45.594177 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9f02d1f1-3c49-4920-aaab-9bdde93856dd tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:45.605387 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9f02d1f1-3c49-4920-aaab-9bdde93856dd tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:45.605913 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9f02d1f1-3c49-4920-aaab-9bdde93856dd tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:45.607204 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9f02d1f1-3c49-4920-aaab-9bdde93856dd tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:45.608204 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9f02d1f1-3c49-4920-aaab-9bdde93856dd tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:45.608663 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9f02d1f1-3c49-4920-aaab-9bdde93856dd tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:45.609401 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9f02d1f1-3c49-4920-aaab-9bdde93856dd tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:45.759755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9f02d1f1-3c49-4920-aaab-9bdde93856dd tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:45.787471 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9f02d1f1-3c49-4920-aaab-9bdde93856dd tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.198217 Aug 30 01:11:45.790245 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 85/186] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:45 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:45.850063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-56133207-8a04-4641-b57e-97f21be5383f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:45.850764 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-56133207-8a04-4641-b57e-97f21be5383f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:45.860935 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-56133207-8a04-4641-b57e-97f21be5383f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:45.861429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-56133207-8a04-4641-b57e-97f21be5383f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:45.864413 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-56133207-8a04-4641-b57e-97f21be5383f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:45.865659 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-56133207-8a04-4641-b57e-97f21be5383f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:45.866301 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-56133207-8a04-4641-b57e-97f21be5383f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:45.869117 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-56133207-8a04-4641-b57e-97f21be5383f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:45.914245 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-490570b4-c1c4-42d3-be15-f743f0b91ea6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:45.915008 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-490570b4-c1c4-42d3-be15-f743f0b91ea6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:45.927656 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-490570b4-c1c4-42d3-be15-f743f0b91ea6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:45.928853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-490570b4-c1c4-42d3-be15-f743f0b91ea6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:45.929584 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-490570b4-c1c4-42d3-be15-f743f0b91ea6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:45.930492 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-490570b4-c1c4-42d3-be15-f743f0b91ea6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:45.931096 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-490570b4-c1c4-42d3-be15-f743f0b91ea6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:45.931667 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-490570b4-c1c4-42d3-be15-f743f0b91ea6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:46.016177 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-56133207-8a04-4641-b57e-97f21be5383f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:46.029971 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-56133207-8a04-4641-b57e-97f21be5383f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:46.031761 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-56133207-8a04-4641-b57e-97f21be5383f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:46.050149 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-56133207-8a04-4641-b57e-97f21be5383f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.193163 Aug 30 01:11:46.050149 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 102/187] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:45 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:46.082661 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-490570b4-c1c4-42d3-be15-f743f0b91ea6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:46.090838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-490570b4-c1c4-42d3-be15-f743f0b91ea6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.189822 Aug 30 01:11:46.091423 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 86/188] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:45 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:46.126968 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-41898153-a8b4-4f91-9668-181f833350b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:46.127515 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-41898153-a8b4-4f91-9668-181f833350b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:46.136382 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-41898153-a8b4-4f91-9668-181f833350b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:46.141614 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-41898153-a8b4-4f91-9668-181f833350b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:46.141614 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-41898153-a8b4-4f91-9668-181f833350b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:46.141614 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-41898153-a8b4-4f91-9668-181f833350b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:46.141614 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-41898153-a8b4-4f91-9668-181f833350b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:46.142183 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-41898153-a8b4-4f91-9668-181f833350b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:46.295107 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-41898153-a8b4-4f91-9668-181f833350b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:46.304907 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5a03f471-2593-4b12-9765-a741875c3c0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:46.307835 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5a03f471-2593-4b12-9765-a741875c3c0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:46.312518 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-41898153-a8b4-4f91-9668-181f833350b6 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.188928 Aug 30 01:11:46.316387 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 103/189] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:46 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:46.334420 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a03f471-2593-4b12-9765-a741875c3c0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:46.334923 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a03f471-2593-4b12-9765-a741875c3c0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:46.335484 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a03f471-2593-4b12-9765-a741875c3c0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:46.336250 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a03f471-2593-4b12-9765-a741875c3c0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:46.336765 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a03f471-2593-4b12-9765-a741875c3c0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:46.337193 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a03f471-2593-4b12-9765-a741875c3c0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:46.572321 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5a03f471-2593-4b12-9765-a741875c3c0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:46.581322 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5a03f471-2593-4b12-9765-a741875c3c0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.280478 Aug 30 01:11:46.581942 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 87/190] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:46 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:46.818538 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-aec767b1-91a0-4062-b70a-57eef51f2a51 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:46.818538 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-aec767b1-91a0-4062-b70a-57eef51f2a51 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:46.821034 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aec767b1-91a0-4062-b70a-57eef51f2a51 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:46.821697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aec767b1-91a0-4062-b70a-57eef51f2a51 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:46.822154 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aec767b1-91a0-4062-b70a-57eef51f2a51 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:46.823003 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aec767b1-91a0-4062-b70a-57eef51f2a51 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:46.823599 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aec767b1-91a0-4062-b70a-57eef51f2a51 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:46.824163 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aec767b1-91a0-4062-b70a-57eef51f2a51 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:46.967898 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-aec767b1-91a0-4062-b70a-57eef51f2a51 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:46.979589 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-aec767b1-91a0-4062-b70a-57eef51f2a51 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.169659 Aug 30 01:11:46.982342 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 104/191] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:46 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:47.061276 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-be179928-0454-4777-a85c-4a589d3140a9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:47.063045 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-be179928-0454-4777-a85c-4a589d3140a9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:47.072354 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-be179928-0454-4777-a85c-4a589d3140a9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:47.074540 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-be179928-0454-4777-a85c-4a589d3140a9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:47.077485 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-be179928-0454-4777-a85c-4a589d3140a9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:47.078506 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-be179928-0454-4777-a85c-4a589d3140a9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:47.080063 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-be179928-0454-4777-a85c-4a589d3140a9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:47.080608 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-be179928-0454-4777-a85c-4a589d3140a9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:47.112261 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-01abb159-b34d-4ff9-b94f-1ee3347b114b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:47.112856 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-01abb159-b34d-4ff9-b94f-1ee3347b114b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:47.128366 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-01abb159-b34d-4ff9-b94f-1ee3347b114b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:47.129151 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-01abb159-b34d-4ff9-b94f-1ee3347b114b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:47.129760 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-01abb159-b34d-4ff9-b94f-1ee3347b114b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:47.130601 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-01abb159-b34d-4ff9-b94f-1ee3347b114b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:47.131205 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-01abb159-b34d-4ff9-b94f-1ee3347b114b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:47.131778 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-01abb159-b34d-4ff9-b94f-1ee3347b114b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:47.318906 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-01abb159-b34d-4ff9-b94f-1ee3347b114b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:47.328057 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-01abb159-b34d-4ff9-b94f-1ee3347b114b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.219333 Aug 30 01:11:47.332658 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 105/192] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:47 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:47.339408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d54f0b14-bd94-428b-b3d7-5d5eafe8e761 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:47.340027 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d54f0b14-bd94-428b-b3d7-5d5eafe8e761 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:47.347547 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d54f0b14-bd94-428b-b3d7-5d5eafe8e761 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:47.348447 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d54f0b14-bd94-428b-b3d7-5d5eafe8e761 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:47.349040 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d54f0b14-bd94-428b-b3d7-5d5eafe8e761 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:47.350065 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d54f0b14-bd94-428b-b3d7-5d5eafe8e761 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:47.350784 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d54f0b14-bd94-428b-b3d7-5d5eafe8e761 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:47.351348 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d54f0b14-bd94-428b-b3d7-5d5eafe8e761 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:47.525697 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-be179928-0454-4777-a85c-4a589d3140a9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:47.537275 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-be179928-0454-4777-a85c-4a589d3140a9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:47.538876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-be179928-0454-4777-a85c-4a589d3140a9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:47.540215 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-be179928-0454-4777-a85c-4a589d3140a9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.482842 Aug 30 01:11:47.540857 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 88/193] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:47 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:11:47.546249 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-187ca406-b608-4c5a-ab9c-5ff6549c32b8 req-5c09b4de-5aca-4a89-80b0-dc086f8b91db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5022a2c4-6b00-416c-9a13-63b0dec702b2", "name": "network-vif-plugged", "status": "completed", "tag": "c67f9947-1307-4c65-b66d-e90b9d577330"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:47.557375 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-187ca406-b608-4c5a-ab9c-5ff6549c32b8 req-5c09b4de-5aca-4a89-80b0-dc086f8b91db service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:47.557976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-187ca406-b608-4c5a-ab9c-5ff6549c32b8 req-5c09b4de-5aca-4a89-80b0-dc086f8b91db service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:47.558459 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-187ca406-b608-4c5a-ab9c-5ff6549c32b8 req-5c09b4de-5aca-4a89-80b0-dc086f8b91db service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:47.568881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d54f0b14-bd94-428b-b3d7-5d5eafe8e761 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:47.571205 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-187ca406-b608-4c5a-ab9c-5ff6549c32b8 req-5c09b4de-5aca-4a89-80b0-dc086f8b91db service nova] Creating event network-vif-plugged:c67f9947-1307-4c65-b66d-e90b9d577330 for instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 on hv-cinder-81571 Aug 30 01:11:47.577751 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-187ca406-b608-4c5a-ab9c-5ff6549c32b8 req-5c09b4de-5aca-4a89-80b0-dc086f8b91db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035537 Aug 30 01:11:47.578740 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 89/194] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:47.580349 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d54f0b14-bd94-428b-b3d7-5d5eafe8e761 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1313 microversion: 2.1 time: 0.244970 Aug 30 01:11:47.581975 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 106/195] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:47 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:47.603001 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b28b1dd9-f551-474c-99f4-f1b9da4d4e4b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:47.603749 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b28b1dd9-f551-474c-99f4-f1b9da4d4e4b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:47.610279 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b28b1dd9-f551-474c-99f4-f1b9da4d4e4b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:47.610763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b28b1dd9-f551-474c-99f4-f1b9da4d4e4b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:47.611242 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b28b1dd9-f551-474c-99f4-f1b9da4d4e4b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:47.611933 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b28b1dd9-f551-474c-99f4-f1b9da4d4e4b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:47.612382 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b28b1dd9-f551-474c-99f4-f1b9da4d4e4b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:47.612801 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b28b1dd9-f551-474c-99f4-f1b9da4d4e4b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:47.748095 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b28b1dd9-f551-474c-99f4-f1b9da4d4e4b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:47.783387 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b28b1dd9-f551-474c-99f4-f1b9da4d4e4b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.184378 Aug 30 01:11:47.783976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 90/196] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:47 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:48.002269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-92cd3ef1-0c0e-4552-8b44-6d02596c984f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:48.003499 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-92cd3ef1-0c0e-4552-8b44-6d02596c984f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:48.010527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-92cd3ef1-0c0e-4552-8b44-6d02596c984f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:48.011254 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-92cd3ef1-0c0e-4552-8b44-6d02596c984f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:48.011833 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-92cd3ef1-0c0e-4552-8b44-6d02596c984f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:48.013292 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-92cd3ef1-0c0e-4552-8b44-6d02596c984f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:48.014124 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-92cd3ef1-0c0e-4552-8b44-6d02596c984f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:48.014706 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-92cd3ef1-0c0e-4552-8b44-6d02596c984f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:48.165138 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-92cd3ef1-0c0e-4552-8b44-6d02596c984f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:48.174308 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-92cd3ef1-0c0e-4552-8b44-6d02596c984f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.176003 Aug 30 01:11:48.180313 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 107/197] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:47 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:48.352508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c5d2fba6-1bc4-467a-bb2e-e76a30454691 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:48.353842 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c5d2fba6-1bc4-467a-bb2e-e76a30454691 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:48.360817 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c5d2fba6-1bc4-467a-bb2e-e76a30454691 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:48.361606 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c5d2fba6-1bc4-467a-bb2e-e76a30454691 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:48.362066 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c5d2fba6-1bc4-467a-bb2e-e76a30454691 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:48.362936 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c5d2fba6-1bc4-467a-bb2e-e76a30454691 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:48.363387 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c5d2fba6-1bc4-467a-bb2e-e76a30454691 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:48.363979 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c5d2fba6-1bc4-467a-bb2e-e76a30454691 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:48.522943 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c5d2fba6-1bc4-467a-bb2e-e76a30454691 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:48.531737 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c5d2fba6-1bc4-467a-bb2e-e76a30454691 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.183093 Aug 30 01:11:48.532626 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 91/198] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:48 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:48.563358 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c6ab04ee-b59a-43a2-a8be-c36e8ce37266 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:48.563967 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c6ab04ee-b59a-43a2-a8be-c36e8ce37266 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:48.570015 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c6ab04ee-b59a-43a2-a8be-c36e8ce37266 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:48.576908 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c6ab04ee-b59a-43a2-a8be-c36e8ce37266 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:48.586886 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c6ab04ee-b59a-43a2-a8be-c36e8ce37266 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:48.587654 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c6ab04ee-b59a-43a2-a8be-c36e8ce37266 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:48.588124 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c6ab04ee-b59a-43a2-a8be-c36e8ce37266 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:48.588549 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c6ab04ee-b59a-43a2-a8be-c36e8ce37266 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:48.601981 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dff1291f-7c73-4101-9739-dd5c6312fd2c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:48.602817 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dff1291f-7c73-4101-9739-dd5c6312fd2c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:48.610253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dff1291f-7c73-4101-9739-dd5c6312fd2c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:48.610888 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dff1291f-7c73-4101-9739-dd5c6312fd2c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:48.611327 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dff1291f-7c73-4101-9739-dd5c6312fd2c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:48.612089 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dff1291f-7c73-4101-9739-dd5c6312fd2c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:48.612784 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dff1291f-7c73-4101-9739-dd5c6312fd2c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:48.613213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dff1291f-7c73-4101-9739-dd5c6312fd2c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:48.760124 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dff1291f-7c73-4101-9739-dd5c6312fd2c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:48.768971 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dff1291f-7c73-4101-9739-dd5c6312fd2c tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1500 microversion: 2.1 time: 0.171218 Aug 30 01:11:48.769762 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 92/199] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:48 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1500 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:48.803970 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-17e5801c-8c8f-41da-9b77-424717e0e8be tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:48.804548 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-17e5801c-8c8f-41da-9b77-424717e0e8be tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:48.810758 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17e5801c-8c8f-41da-9b77-424717e0e8be tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:48.811626 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17e5801c-8c8f-41da-9b77-424717e0e8be tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:48.812210 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17e5801c-8c8f-41da-9b77-424717e0e8be tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:48.813061 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17e5801c-8c8f-41da-9b77-424717e0e8be tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:48.813655 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17e5801c-8c8f-41da-9b77-424717e0e8be tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:48.814237 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17e5801c-8c8f-41da-9b77-424717e0e8be tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:48.912900 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c6ab04ee-b59a-43a2-a8be-c36e8ce37266 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:48.927433 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c6ab04ee-b59a-43a2-a8be-c36e8ce37266 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:48.929475 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c6ab04ee-b59a-43a2-a8be-c36e8ce37266 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:48.931056 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c6ab04ee-b59a-43a2-a8be-c36e8ce37266 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.371815 Aug 30 01:11:48.932311 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 108/200] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:48 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:49.017860 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-17e5801c-8c8f-41da-9b77-424717e0e8be tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:49.030407 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-17e5801c-8c8f-41da-9b77-424717e0e8be tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1321 microversion: 2.1 time: 0.229983 Aug 30 01:11:49.031000 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 93/201] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:48 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:49.196216 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b3aa2b5d-0be6-4a4d-bcd2-b478ac41b424 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:49.196820 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b3aa2b5d-0be6-4a4d-bcd2-b478ac41b424 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:49.203086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b3aa2b5d-0be6-4a4d-bcd2-b478ac41b424 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:49.203577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b3aa2b5d-0be6-4a4d-bcd2-b478ac41b424 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:49.204010 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b3aa2b5d-0be6-4a4d-bcd2-b478ac41b424 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:49.204699 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b3aa2b5d-0be6-4a4d-bcd2-b478ac41b424 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:49.205148 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b3aa2b5d-0be6-4a4d-bcd2-b478ac41b424 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:49.205564 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b3aa2b5d-0be6-4a4d-bcd2-b478ac41b424 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:49.544109 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-b3aa2b5d-0be6-4a4d-bcd2-b478ac41b424 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:49.556417 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ceb6b14f-0de3-484e-8288-897fea7846f6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:49.560015 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ceb6b14f-0de3-484e-8288-897fea7846f6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:49.567039 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-b3aa2b5d-0be6-4a4d-bcd2-b478ac41b424 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.374528 Aug 30 01:11:49.567386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceb6b14f-0de3-484e-8288-897fea7846f6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:49.568599 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceb6b14f-0de3-484e-8288-897fea7846f6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:49.568599 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceb6b14f-0de3-484e-8288-897fea7846f6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:49.568962 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceb6b14f-0de3-484e-8288-897fea7846f6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:49.569428 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceb6b14f-0de3-484e-8288-897fea7846f6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:49.569812 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 109/202] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:49 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:49.569945 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceb6b14f-0de3-484e-8288-897fea7846f6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:49.762688 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ceb6b14f-0de3-484e-8288-897fea7846f6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:49.770778 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ceb6b14f-0de3-484e-8288-897fea7846f6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.220113 Aug 30 01:11:49.771367 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 94/203] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:49 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:49.955949 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4b017306-c6ba-44ef-aaed-7aeace5ccc99 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:49.956742 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4b017306-c6ba-44ef-aaed-7aeace5ccc99 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:49.968783 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4b017306-c6ba-44ef-aaed-7aeace5ccc99 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:49.969272 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4b017306-c6ba-44ef-aaed-7aeace5ccc99 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:49.972497 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4b017306-c6ba-44ef-aaed-7aeace5ccc99 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:49.973147 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4b017306-c6ba-44ef-aaed-7aeace5ccc99 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:49.973617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4b017306-c6ba-44ef-aaed-7aeace5ccc99 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:49.974077 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4b017306-c6ba-44ef-aaed-7aeace5ccc99 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:50.059130 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-de939a1c-47d7-46d7-a5e3-44174a4faad3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:50.060315 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-de939a1c-47d7-46d7-a5e3-44174a4faad3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:50.073680 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de939a1c-47d7-46d7-a5e3-44174a4faad3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:50.075725 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de939a1c-47d7-46d7-a5e3-44174a4faad3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:50.077558 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de939a1c-47d7-46d7-a5e3-44174a4faad3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:50.080838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de939a1c-47d7-46d7-a5e3-44174a4faad3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:50.083699 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de939a1c-47d7-46d7-a5e3-44174a4faad3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:50.085235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de939a1c-47d7-46d7-a5e3-44174a4faad3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:50.170914 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4b017306-c6ba-44ef-aaed-7aeace5ccc99 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:50.184950 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4b017306-c6ba-44ef-aaed-7aeace5ccc99 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:50.187205 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4b017306-c6ba-44ef-aaed-7aeace5ccc99 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:50.188606 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4b017306-c6ba-44ef-aaed-7aeace5ccc99 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.238224 Aug 30 01:11:50.189168 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 110/204] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:49 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:11:50.210467 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-5c7e9adc-79cb-4d8d-a40b-452242db6aab req-26a75fe4-e270-472e-b47b-9ace54a0bc38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4475905-983f-47fb-8b8e-6c87baeac22d", "name": "network-vif-plugged", "status": "completed", "tag": "3efaeb1f-3500-4863-b27f-c56c1aa2946c"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:50.233242 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-5c7e9adc-79cb-4d8d-a40b-452242db6aab req-26a75fe4-e270-472e-b47b-9ace54a0bc38 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:50.233753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-5c7e9adc-79cb-4d8d-a40b-452242db6aab req-26a75fe4-e270-472e-b47b-9ace54a0bc38 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:50.235364 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-5c7e9adc-79cb-4d8d-a40b-452242db6aab req-26a75fe4-e270-472e-b47b-9ace54a0bc38 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:50.255456 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-5c7e9adc-79cb-4d8d-a40b-452242db6aab req-26a75fe4-e270-472e-b47b-9ace54a0bc38 service nova] Creating event network-vif-plugged:3efaeb1f-3500-4863-b27f-c56c1aa2946c for instance d4475905-983f-47fb-8b8e-6c87baeac22d on hv-cinder-81571 Aug 30 01:11:50.260701 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-5c7e9adc-79cb-4d8d-a40b-452242db6aab req-26a75fe4-e270-472e-b47b-9ace54a0bc38 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070128 Aug 30 01:11:50.261429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 111/205] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:50.300593 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-de939a1c-47d7-46d7-a5e3-44174a4faad3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:50.311551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-de939a1c-47d7-46d7-a5e3-44174a4faad3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1516 microversion: 2.1 time: 0.260677 Aug 30 01:11:50.320246 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 95/206] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:50 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:50.335296 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f7684945-0bdf-4793-a5f0-d0414f2d224a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:50.338514 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f7684945-0bdf-4793-a5f0-d0414f2d224a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:50.345433 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7684945-0bdf-4793-a5f0-d0414f2d224a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:50.346149 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7684945-0bdf-4793-a5f0-d0414f2d224a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:50.346969 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7684945-0bdf-4793-a5f0-d0414f2d224a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:50.347946 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7684945-0bdf-4793-a5f0-d0414f2d224a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:50.348806 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7684945-0bdf-4793-a5f0-d0414f2d224a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:50.349333 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7684945-0bdf-4793-a5f0-d0414f2d224a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:50.421824 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-f7684945-0bdf-4793-a5f0-d0414f2d224a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lazy-loading 'flavor' on Instance uuid b016168d-f295-4bb4-9da1-36472ad69576 {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:11:50.596896 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4a8dbebc-bab3-4b82-9994-cec8f0cb3fec tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:50.598295 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4a8dbebc-bab3-4b82-9994-cec8f0cb3fec tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:50.604656 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a8dbebc-bab3-4b82-9994-cec8f0cb3fec tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:50.605413 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a8dbebc-bab3-4b82-9994-cec8f0cb3fec tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:50.610590 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a8dbebc-bab3-4b82-9994-cec8f0cb3fec tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:50.610590 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a8dbebc-bab3-4b82-9994-cec8f0cb3fec tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:50.610590 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a8dbebc-bab3-4b82-9994-cec8f0cb3fec tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:50.610590 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a8dbebc-bab3-4b82-9994-cec8f0cb3fec tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:50.794887 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4a8dbebc-bab3-4b82-9994-cec8f0cb3fec tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:50.805619 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4a8dbebc-bab3-4b82-9994-cec8f0cb3fec tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1364 microversion: 2.1 time: 0.212447 Aug 30 01:11:50.807353 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 96/207] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:50 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:50.812561 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-78f0772b-7d95-477d-9e05-b98bc16ca92e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:50.813354 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-78f0772b-7d95-477d-9e05-b98bc16ca92e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:50.819628 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78f0772b-7d95-477d-9e05-b98bc16ca92e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:50.826304 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78f0772b-7d95-477d-9e05-b98bc16ca92e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:50.826304 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78f0772b-7d95-477d-9e05-b98bc16ca92e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:50.826304 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78f0772b-7d95-477d-9e05-b98bc16ca92e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:50.826304 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78f0772b-7d95-477d-9e05-b98bc16ca92e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:50.826885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78f0772b-7d95-477d-9e05-b98bc16ca92e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:50.844727 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:50.886159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f7684945-0bdf-4793-a5f0-d0414f2d224a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "POST /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576/action" status: 200 len: 32 microversion: 2.1 time: 0.556172 Aug 30 01:11:50.886922 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 112/208] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 30 01:11:50 2022] POST /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576/action => generated 32 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:11:50.893649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-7b1a4c6b-68d1-4724-809c-4576210fd477 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52600c3f-9eac-4943-bef0-9c14ea954dbb"}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:50.896020 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-7b1a4c6b-68d1-4724-809c-4576210fd477 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:50.902378 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b1a4c6b-68d1-4724-809c-4576210fd477 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:50.902855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b1a4c6b-68d1-4724-809c-4576210fd477 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:50.903802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b1a4c6b-68d1-4724-809c-4576210fd477 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:50.904600 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b1a4c6b-68d1-4724-809c-4576210fd477 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:50.905054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b1a4c6b-68d1-4724-809c-4576210fd477 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:50.905475 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b1a4c6b-68d1-4724-809c-4576210fd477 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:50.980459 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-78f0772b-7d95-477d-9e05-b98bc16ca92e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:50.990062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-78f0772b-7d95-477d-9e05-b98bc16ca92e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.181462 Aug 30 01:11:50.991999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 97/209] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:50 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:50.998637 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-74b2ec16-b546-4473-af1f-4ac7be85d534 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:50.999348 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-74b2ec16-b546-4473-af1f-4ac7be85d534 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:51.009629 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74b2ec16-b546-4473-af1f-4ac7be85d534 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:51.027159 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74b2ec16-b546-4473-af1f-4ac7be85d534 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:51.027159 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74b2ec16-b546-4473-af1f-4ac7be85d534 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:51.027159 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74b2ec16-b546-4473-af1f-4ac7be85d534 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:51.027159 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74b2ec16-b546-4473-af1f-4ac7be85d534 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:51.027541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74b2ec16-b546-4473-af1f-4ac7be85d534 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:51.187155 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-74b2ec16-b546-4473-af1f-4ac7be85d534 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:51.199320 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-74b2ec16-b546-4473-af1f-4ac7be85d534 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.202040 Aug 30 01:11:51.199320 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 98/210] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:50 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:51.212175 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-87a7dee8-0e92-4bd8-b0e1-6f8245770cca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:51.212787 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-87a7dee8-0e92-4bd8-b0e1-6f8245770cca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:51.219136 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87a7dee8-0e92-4bd8-b0e1-6f8245770cca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:51.219624 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87a7dee8-0e92-4bd8-b0e1-6f8245770cca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:51.220188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87a7dee8-0e92-4bd8-b0e1-6f8245770cca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:51.221240 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87a7dee8-0e92-4bd8-b0e1-6f8245770cca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:51.221696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87a7dee8-0e92-4bd8-b0e1-6f8245770cca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:51.222157 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87a7dee8-0e92-4bd8-b0e1-6f8245770cca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:51.370074 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-87a7dee8-0e92-4bd8-b0e1-6f8245770cca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:51.378893 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-87a7dee8-0e92-4bd8-b0e1-6f8245770cca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:51.380309 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-87a7dee8-0e92-4bd8-b0e1-6f8245770cca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:51.381414 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-87a7dee8-0e92-4bd8-b0e1-6f8245770cca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.173473 Aug 30 01:11:51.382038 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 99/211] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:51 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:51.832588 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1c8702d7-ed2b-47c5-b632-ce2702669cfa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:51.833337 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1c8702d7-ed2b-47c5-b632-ce2702669cfa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:51.841483 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1c8702d7-ed2b-47c5-b632-ce2702669cfa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:51.842133 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1c8702d7-ed2b-47c5-b632-ce2702669cfa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:51.842664 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1c8702d7-ed2b-47c5-b632-ce2702669cfa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:51.843450 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1c8702d7-ed2b-47c5-b632-ce2702669cfa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:51.844075 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1c8702d7-ed2b-47c5-b632-ce2702669cfa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:51.844746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1c8702d7-ed2b-47c5-b632-ce2702669cfa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:51.985264 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1c8702d7-ed2b-47c5-b632-ce2702669cfa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:51.994910 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1c8702d7-ed2b-47c5-b632-ce2702669cfa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1549 microversion: 2.1 time: 0.167245 Aug 30 01:11:51.995915 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 100/212] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:51 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:52.019811 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-858d5356-02d5-480c-a0bc-4ad60111dc8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:52.020687 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-858d5356-02d5-480c-a0bc-4ad60111dc8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:52.029822 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-858d5356-02d5-480c-a0bc-4ad60111dc8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:52.030553 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-858d5356-02d5-480c-a0bc-4ad60111dc8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:52.031928 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-858d5356-02d5-480c-a0bc-4ad60111dc8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:52.032868 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-858d5356-02d5-480c-a0bc-4ad60111dc8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:52.033417 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-858d5356-02d5-480c-a0bc-4ad60111dc8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:52.034490 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-858d5356-02d5-480c-a0bc-4ad60111dc8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:52.288956 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-858d5356-02d5-480c-a0bc-4ad60111dc8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:52.298627 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-858d5356-02d5-480c-a0bc-4ad60111dc8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.286211 Aug 30 01:11:52.299526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 101/213] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:52 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:52.305039 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-130fc843-81cc-4925-965c-5493f950e5ac tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:52.305850 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-130fc843-81cc-4925-965c-5493f950e5ac tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:52.315178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-130fc843-81cc-4925-965c-5493f950e5ac tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:52.316884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-130fc843-81cc-4925-965c-5493f950e5ac tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:52.316884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-130fc843-81cc-4925-965c-5493f950e5ac tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:52.317618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-130fc843-81cc-4925-965c-5493f950e5ac tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:52.318449 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-130fc843-81cc-4925-965c-5493f950e5ac tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:52.319031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-130fc843-81cc-4925-965c-5493f950e5ac tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:52.353203 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-7b1a4c6b-68d1-4724-809c-4576210fd477 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "POST /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.463184 Aug 30 01:11:52.357156 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 113/214] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 30 01:11:50 2022] POST /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a/os-volume_attachments => generated 194 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:52.359987 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c129cd77-3e4c-4aaf-8e1f-18feff153833 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:52.360976 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c129cd77-3e4c-4aaf-8e1f-18feff153833 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:52.369090 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c129cd77-3e4c-4aaf-8e1f-18feff153833 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:52.369782 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c129cd77-3e4c-4aaf-8e1f-18feff153833 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:52.370328 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c129cd77-3e4c-4aaf-8e1f-18feff153833 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:52.371304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c129cd77-3e4c-4aaf-8e1f-18feff153833 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:52.371868 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c129cd77-3e4c-4aaf-8e1f-18feff153833 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:52.372431 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c129cd77-3e4c-4aaf-8e1f-18feff153833 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:52.538916 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-130fc843-81cc-4925-965c-5493f950e5ac tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.225533 Aug 30 01:11:52.538916 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 102/215] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 30 01:11:52 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/os-interface => generated 284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:52.538916 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-ebf97a6c-e1f2-4325-9449-f67e9baa9707 req-881d8c7b-9684-44ef-b342-c1a5b5dc0511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec6af1b-90af-41d0-9778-9c0d89e330bc", "name": "network-vif-plugged", "status": "completed", "tag": "66ac913d-aad3-451a-96e1-8f106967b9a5"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:52.539920 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c129cd77-3e4c-4aaf-8e1f-18feff153833 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:52.543917 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:52.544343 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ebf97a6c-e1f2-4325-9449-f67e9baa9707 req-881d8c7b-9684-44ef-b342-c1a5b5dc0511 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:52.544998 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ebf97a6c-e1f2-4325-9449-f67e9baa9707 req-881d8c7b-9684-44ef-b342-c1a5b5dc0511 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:52.545595 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ebf97a6c-e1f2-4325-9449-f67e9baa9707 req-881d8c7b-9684-44ef-b342-c1a5b5dc0511 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:52.549171 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c129cd77-3e4c-4aaf-8e1f-18feff153833 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.193841 Aug 30 01:11:52.550065 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 114/216] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:52 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:52.554721 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6a3308e7-a454-4cb3-b3cf-f35fb13c333a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:52.555312 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6a3308e7-a454-4cb3-b3cf-f35fb13c333a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:52.562052 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a3308e7-a454-4cb3-b3cf-f35fb13c333a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:52.562746 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a3308e7-a454-4cb3-b3cf-f35fb13c333a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:52.563331 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a3308e7-a454-4cb3-b3cf-f35fb13c333a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:52.564191 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a3308e7-a454-4cb3-b3cf-f35fb13c333a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:52.564638 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a3308e7-a454-4cb3-b3cf-f35fb13c333a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:52.565179 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a3308e7-a454-4cb3-b3cf-f35fb13c333a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:52.572243 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-ebf97a6c-e1f2-4325-9449-f67e9baa9707 req-881d8c7b-9684-44ef-b342-c1a5b5dc0511 service nova] Creating event network-vif-plugged:66ac913d-aad3-451a-96e1-8f106967b9a5 for instance aec6af1b-90af-41d0-9778-9c0d89e330bc on hv-cinder-81571 Aug 30 01:11:52.578285 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-ebf97a6c-e1f2-4325-9449-f67e9baa9707 req-881d8c7b-9684-44ef-b342-c1a5b5dc0511 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049655 Aug 30 01:11:52.578907 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 103/217] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:52.587550 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1744633409", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452", "networks": [{"uuid": "9fb68cff-0330-4b4f-897d-a5b9f49b6d9f"}]}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:52.646154 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] validate_networks() for [('9fb68cff-0330-4b4f-897d-a5b9f49b6d9f', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:11:52.915783 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6a3308e7-a454-4cb3-b3cf-f35fb13c333a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:52.929596 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6a3308e7-a454-4cb3-b3cf-f35fb13c333a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:52.931539 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6a3308e7-a454-4cb3-b3cf-f35fb13c333a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:52.935514 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6a3308e7-a454-4cb3-b3cf-f35fb13c333a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1407 microversion: 2.20 time: 0.384603 Aug 30 01:11:52.946460 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 115/218] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:52 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1407 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:11:53.151822 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:11:53.152687 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:11:53.152788 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:11:53.153913 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:11:53.154441 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:11:53.166513 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:53.169452 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:53.169452 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:53.169452 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:53.169452 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:53.169909 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:53.189699 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Getting quotas for project 43f140e0f58f42ae96e16f80b480621c. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:11:53.194341 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Getting quotas for user 1b225b55d18740c2833cade52edc556e and project 43f140e0f58f42ae96e16f80b480621c. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:11:53.208581 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:11:53.209917 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:11:53.321037 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2e3ee8db-75ac-40fd-a618-d29f9588458c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:53.321548 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2e3ee8db-75ac-40fd-a618-d29f9588458c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:53.335393 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e3ee8db-75ac-40fd-a618-d29f9588458c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:53.336255 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e3ee8db-75ac-40fd-a618-d29f9588458c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:53.336255 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e3ee8db-75ac-40fd-a618-d29f9588458c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:53.336983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e3ee8db-75ac-40fd-a618-d29f9588458c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:53.337435 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e3ee8db-75ac-40fd-a618-d29f9588458c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:53.337888 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e3ee8db-75ac-40fd-a618-d29f9588458c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:53.429215 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0c40558a-9b75-4464-a046-efaa16a6d3bb tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845661 Aug 30 01:11:53.430084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 104/219] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:11:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:11:53.441940 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-57d93e4a-306a-49ff-99de-4ab12ecb4be1 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:53.442937 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-57d93e4a-306a-49ff-99de-4ab12ecb4be1 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:53.446827 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:53.509709 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-57d93e4a-306a-49ff-99de-4ab12ecb4be1 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:53.518723 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-57d93e4a-306a-49ff-99de-4ab12ecb4be1 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1214 microversion: 2.1 time: 0.080760 Aug 30 01:11:53.519936 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 105/220] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:53 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:53.558239 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2e3ee8db-75ac-40fd-a618-d29f9588458c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:53.569982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2e3ee8db-75ac-40fd-a618-d29f9588458c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.253022 Aug 30 01:11:53.572334 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-216b55ab-fcde-4b9e-95d4-65071e492abc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:53.573323 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-216b55ab-fcde-4b9e-95d4-65071e492abc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:53.582544 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 116/221] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:53 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:53.586136 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-216b55ab-fcde-4b9e-95d4-65071e492abc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:53.587137 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-216b55ab-fcde-4b9e-95d4-65071e492abc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:53.588917 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-216b55ab-fcde-4b9e-95d4-65071e492abc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:53.590256 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-216b55ab-fcde-4b9e-95d4-65071e492abc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:53.591129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-216b55ab-fcde-4b9e-95d4-65071e492abc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:53.591754 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-216b55ab-fcde-4b9e-95d4-65071e492abc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:53.892883 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-216b55ab-fcde-4b9e-95d4-65071e492abc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:53.902398 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-216b55ab-fcde-4b9e-95d4-65071e492abc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.335727 Aug 30 01:11:53.905143 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 106/222] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:53 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:11:53.962237 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-7f0bc971-9e7c-4c1d-a4ee-94d01b087d44 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:53.962953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-7f0bc971-9e7c-4c1d-a4ee-94d01b087d44 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:53.970523 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7f0bc971-9e7c-4c1d-a4ee-94d01b087d44 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:53.971433 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7f0bc971-9e7c-4c1d-a4ee-94d01b087d44 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:53.972021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7f0bc971-9e7c-4c1d-a4ee-94d01b087d44 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:53.972890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7f0bc971-9e7c-4c1d-a4ee-94d01b087d44 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:53.973538 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7f0bc971-9e7c-4c1d-a4ee-94d01b087d44 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:53.974026 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7f0bc971-9e7c-4c1d-a4ee-94d01b087d44 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:54.390560 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7f0bc971-9e7c-4c1d-a4ee-94d01b087d44 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:54.430450 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-5a22072d-be4b-4662-9f6d-e90546549567 req-785a740c-3d42-4d23-bfaa-b1d386799100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5022a2c4-6b00-416c-9a13-63b0dec702b2", "tag": "c67f9947-1307-4c65-b66d-e90b9d577330"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:54.435518 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7f0bc971-9e7c-4c1d-a4ee-94d01b087d44 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:54.439780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7f0bc971-9e7c-4c1d-a4ee-94d01b087d44 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:54.439780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-7f0bc971-9e7c-4c1d-a4ee-94d01b087d44 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1598 microversion: 2.20 time: 0.482631 Aug 30 01:11:54.440543 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 117/223] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:11:53 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1598 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:11:54.441504 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-5a22072d-be4b-4662-9f6d-e90546549567 req-785a740c-3d42-4d23-bfaa-b1d386799100 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:54.442207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-5a22072d-be4b-4662-9f6d-e90546549567 req-785a740c-3d42-4d23-bfaa-b1d386799100 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:54.442813 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-5a22072d-be4b-4662-9f6d-e90546549567 req-785a740c-3d42-4d23-bfaa-b1d386799100 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:54.472724 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d6138700-3cca-4004-9701-19fb50b50b3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:54.479855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d6138700-3cca-4004-9701-19fb50b50b3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:54.480011 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-5a22072d-be4b-4662-9f6d-e90546549567 req-785a740c-3d42-4d23-bfaa-b1d386799100 service nova] Creating event network-changed:c67f9947-1307-4c65-b66d-e90b9d577330 for instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 on hv-cinder-81571 Aug 30 01:11:54.485505 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-5a22072d-be4b-4662-9f6d-e90546549567 req-785a740c-3d42-4d23-bfaa-b1d386799100 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059371 Aug 30 01:11:54.491449 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 107/224] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:11:54.496832 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d6138700-3cca-4004-9701-19fb50b50b3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:54.498030 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d6138700-3cca-4004-9701-19fb50b50b3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:54.498646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d6138700-3cca-4004-9701-19fb50b50b3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:54.499402 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d6138700-3cca-4004-9701-19fb50b50b3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:54.499867 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d6138700-3cca-4004-9701-19fb50b50b3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:54.500440 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d6138700-3cca-4004-9701-19fb50b50b3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:54.549106 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-97b53db2-78fc-4a3d-9320-fed683db9f79 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:54.549846 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-97b53db2-78fc-4a3d-9320-fed683db9f79 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:54.595648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d6138700-3cca-4004-9701-19fb50b50b3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.134725 Aug 30 01:11:54.602878 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 118/225] 10.222.0.52 () {60 vars in 1316 bytes} [Tue Aug 30 01:11:54 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:11:54.615597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f30c0247-24b8-48c1-8731-b5c9692a4fe0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:54.616433 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f30c0247-24b8-48c1-8731-b5c9692a4fe0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:54.627007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f30c0247-24b8-48c1-8731-b5c9692a4fe0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:54.627445 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-97b53db2-78fc-4a3d-9320-fed683db9f79 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:54.634683 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f30c0247-24b8-48c1-8731-b5c9692a4fe0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:54.635548 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f30c0247-24b8-48c1-8731-b5c9692a4fe0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:54.636464 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f30c0247-24b8-48c1-8731-b5c9692a4fe0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:54.639490 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f30c0247-24b8-48c1-8731-b5c9692a4fe0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:54.640051 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-97b53db2-78fc-4a3d-9320-fed683db9f79 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1214 microversion: 2.1 time: 0.096872 Aug 30 01:11:54.640250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f30c0247-24b8-48c1-8731-b5c9692a4fe0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:54.641813 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 108/226] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:54 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:54.928668 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-840fe0d9-0803-4c1f-98bb-851c3b37f733 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:54.931039 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-840fe0d9-0803-4c1f-98bb-851c3b37f733 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:54.939037 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-840fe0d9-0803-4c1f-98bb-851c3b37f733 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:54.942468 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-840fe0d9-0803-4c1f-98bb-851c3b37f733 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:54.943294 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-840fe0d9-0803-4c1f-98bb-851c3b37f733 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:54.944276 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-840fe0d9-0803-4c1f-98bb-851c3b37f733 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:54.945706 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-840fe0d9-0803-4c1f-98bb-851c3b37f733 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:54.946361 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-840fe0d9-0803-4c1f-98bb-851c3b37f733 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:54.957893 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f30c0247-24b8-48c1-8731-b5c9692a4fe0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:54.967076 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f30c0247-24b8-48c1-8731-b5c9692a4fe0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.361591 Aug 30 01:11:54.970156 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 119/227] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:54 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:55.121054 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-840fe0d9-0803-4c1f-98bb-851c3b37f733 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:55.130013 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-840fe0d9-0803-4c1f-98bb-851c3b37f733 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.206076 Aug 30 01:11:55.130826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 109/228] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:54 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:55.680385 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b117d452-4948-4e47-9a2a-3b7cb1f223a9 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:55.681035 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b117d452-4948-4e47-9a2a-3b7cb1f223a9 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:55.689852 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b117d452-4948-4e47-9a2a-3b7cb1f223a9 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:55.690346 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b117d452-4948-4e47-9a2a-3b7cb1f223a9 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:55.694397 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b117d452-4948-4e47-9a2a-3b7cb1f223a9 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:55.695542 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b117d452-4948-4e47-9a2a-3b7cb1f223a9 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:55.696549 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b117d452-4948-4e47-9a2a-3b7cb1f223a9 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:55.697256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b117d452-4948-4e47-9a2a-3b7cb1f223a9 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:55.829008 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-b117d452-4948-4e47-9a2a-3b7cb1f223a9 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:55.860505 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-b117d452-4948-4e47-9a2a-3b7cb1f223a9 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1218 microversion: 2.1 time: 0.186937 Aug 30 01:11:55.860505 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 120/229] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:55 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1218 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:55.994269 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0c35a454-0d39-48b6-87ba-916055dfe92a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:55.994269 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0c35a454-0d39-48b6-87ba-916055dfe92a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:56.002153 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c35a454-0d39-48b6-87ba-916055dfe92a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:56.002650 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c35a454-0d39-48b6-87ba-916055dfe92a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:56.003088 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c35a454-0d39-48b6-87ba-916055dfe92a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:56.003825 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c35a454-0d39-48b6-87ba-916055dfe92a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:56.004278 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c35a454-0d39-48b6-87ba-916055dfe92a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:56.004914 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c35a454-0d39-48b6-87ba-916055dfe92a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:56.154213 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f0f6fd15-6e4e-4b33-a921-48171b962934 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:56.155705 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f0f6fd15-6e4e-4b33-a921-48171b962934 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:56.164631 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0c35a454-0d39-48b6-87ba-916055dfe92a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:56.171847 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0f6fd15-6e4e-4b33-a921-48171b962934 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:56.172354 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0f6fd15-6e4e-4b33-a921-48171b962934 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:56.173052 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0f6fd15-6e4e-4b33-a921-48171b962934 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:56.173773 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0f6fd15-6e4e-4b33-a921-48171b962934 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:56.176445 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0c35a454-0d39-48b6-87ba-916055dfe92a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1365 microversion: 2.1 time: 0.187668 Aug 30 01:11:56.190479 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 110/230] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:55 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:56.190976 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0f6fd15-6e4e-4b33-a921-48171b962934 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:56.191377 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0f6fd15-6e4e-4b33-a921-48171b962934 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:56.351225 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f0f6fd15-6e4e-4b33-a921-48171b962934 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:56.366423 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f0f6fd15-6e4e-4b33-a921-48171b962934 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.217671 Aug 30 01:11:56.367268 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 121/231] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:56 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:56.501511 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-c1c40349-1d49-4c2e-83a3-40f58a414110 req-5fc53280-6da0-403c-948c-e5dcfc84e0dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4475905-983f-47fb-8b8e-6c87baeac22d", "tag": "3efaeb1f-3500-4863-b27f-c56c1aa2946c"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:56.517469 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c1c40349-1d49-4c2e-83a3-40f58a414110 req-5fc53280-6da0-403c-948c-e5dcfc84e0dd service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:56.518051 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c1c40349-1d49-4c2e-83a3-40f58a414110 req-5fc53280-6da0-403c-948c-e5dcfc84e0dd service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:56.519555 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c1c40349-1d49-4c2e-83a3-40f58a414110 req-5fc53280-6da0-403c-948c-e5dcfc84e0dd service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:56.536215 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-c1c40349-1d49-4c2e-83a3-40f58a414110 req-5fc53280-6da0-403c-948c-e5dcfc84e0dd service nova] Creating event network-changed:3efaeb1f-3500-4863-b27f-c56c1aa2946c for instance d4475905-983f-47fb-8b8e-6c87baeac22d on hv-cinder-81571 Aug 30 01:11:56.542907 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-c1c40349-1d49-4c2e-83a3-40f58a414110 req-5fc53280-6da0-403c-948c-e5dcfc84e0dd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044927 Aug 30 01:11:56.543957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 111/232] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:56.870728 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-8d4159fc-a52a-4d06-9e23-d7501fe84626 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:56.878932 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-8d4159fc-a52a-4d06-9e23-d7501fe84626 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:56.911265 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8d4159fc-a52a-4d06-9e23-d7501fe84626 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:56.916920 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8d4159fc-a52a-4d06-9e23-d7501fe84626 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:56.916920 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8d4159fc-a52a-4d06-9e23-d7501fe84626 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:56.916920 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8d4159fc-a52a-4d06-9e23-d7501fe84626 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:56.916920 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8d4159fc-a52a-4d06-9e23-d7501fe84626 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:56.917298 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8d4159fc-a52a-4d06-9e23-d7501fe84626 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:56.991916 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-8d4159fc-a52a-4d06-9e23-d7501fe84626 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:57.005129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-8d4159fc-a52a-4d06-9e23-d7501fe84626 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1218 microversion: 2.1 time: 0.139563 Aug 30 01:11:57.007044 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 122/233] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:56 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:57.209472 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a7b5b06f-40cd-4981-8112-3dd7d05b4d60 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:57.210858 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a7b5b06f-40cd-4981-8112-3dd7d05b4d60 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:57.220304 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7b5b06f-40cd-4981-8112-3dd7d05b4d60 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:57.220788 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7b5b06f-40cd-4981-8112-3dd7d05b4d60 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:57.221476 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7b5b06f-40cd-4981-8112-3dd7d05b4d60 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:57.222401 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7b5b06f-40cd-4981-8112-3dd7d05b4d60 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:57.223038 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7b5b06f-40cd-4981-8112-3dd7d05b4d60 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:57.223601 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7b5b06f-40cd-4981-8112-3dd7d05b4d60 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:57.384891 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a7b5b06f-40cd-4981-8112-3dd7d05b4d60 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:57.388158 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-45d259e8-e6bb-4bfc-861d-2f4c7c75890a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:57.388809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-45d259e8-e6bb-4bfc-861d-2f4c7c75890a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:57.394635 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a7b5b06f-40cd-4981-8112-3dd7d05b4d60 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1555 microversion: 2.1 time: 0.189645 Aug 30 01:11:57.399952 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 112/234] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:57 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1555 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:57.400241 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-45d259e8-e6bb-4bfc-861d-2f4c7c75890a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:57.400241 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-45d259e8-e6bb-4bfc-861d-2f4c7c75890a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:57.400241 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-45d259e8-e6bb-4bfc-861d-2f4c7c75890a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:57.400241 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-45d259e8-e6bb-4bfc-861d-2f4c7c75890a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:57.400527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-45d259e8-e6bb-4bfc-861d-2f4c7c75890a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:57.400527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-45d259e8-e6bb-4bfc-861d-2f4c7c75890a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:57.421030 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8b9e8274-7b81-415d-910f-79597deb93af tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:57.428814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8b9e8274-7b81-415d-910f-79597deb93af tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:57.435820 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b9e8274-7b81-415d-910f-79597deb93af tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:57.436650 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b9e8274-7b81-415d-910f-79597deb93af tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:57.437186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b9e8274-7b81-415d-910f-79597deb93af tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:57.438023 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b9e8274-7b81-415d-910f-79597deb93af tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:57.438549 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b9e8274-7b81-415d-910f-79597deb93af tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:57.439198 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b9e8274-7b81-415d-910f-79597deb93af tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:57.527114 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8b9e8274-7b81-415d-910f-79597deb93af tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109963 Aug 30 01:11:57.527972 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 113/235] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 30 01:11:57 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:11:57.592095 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-45d259e8-e6bb-4bfc-861d-2f4c7c75890a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:57.600952 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-45d259e8-e6bb-4bfc-861d-2f4c7c75890a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.217381 Aug 30 01:11:57.601640 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 123/236] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:57 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:58.027415 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1cb204d5-36bb-4cf0-a366-d23488cf4c2e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:58.028604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1cb204d5-36bb-4cf0-a366-d23488cf4c2e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:58.036605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cb204d5-36bb-4cf0-a366-d23488cf4c2e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:58.038581 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cb204d5-36bb-4cf0-a366-d23488cf4c2e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:58.038581 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cb204d5-36bb-4cf0-a366-d23488cf4c2e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:58.038581 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cb204d5-36bb-4cf0-a366-d23488cf4c2e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:58.039027 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cb204d5-36bb-4cf0-a366-d23488cf4c2e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:58.039646 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cb204d5-36bb-4cf0-a366-d23488cf4c2e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:58.169818 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1cb204d5-36bb-4cf0-a366-d23488cf4c2e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:58.180272 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1cb204d5-36bb-4cf0-a366-d23488cf4c2e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1210 microversion: 2.1 time: 0.156663 Aug 30 01:11:58.190288 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 114/237] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:58 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1210 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:58.624625 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5c42d7a6-bfec-4f15-a218-e04641602de3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:58.625927 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5c42d7a6-bfec-4f15-a218-e04641602de3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:58.633998 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c42d7a6-bfec-4f15-a218-e04641602de3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:58.634577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c42d7a6-bfec-4f15-a218-e04641602de3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:58.635217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c42d7a6-bfec-4f15-a218-e04641602de3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:58.636280 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c42d7a6-bfec-4f15-a218-e04641602de3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:58.636890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c42d7a6-bfec-4f15-a218-e04641602de3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:58.638288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c42d7a6-bfec-4f15-a218-e04641602de3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:58.785888 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5c42d7a6-bfec-4f15-a218-e04641602de3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:58.793890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5c42d7a6-bfec-4f15-a218-e04641602de3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.174769 Aug 30 01:11:58.794458 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 124/238] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:58 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:59.203005 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d63268f1-a718-4635-ae94-49804b732c79 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:59.203937 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d63268f1-a718-4635-ae94-49804b732c79 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:59.210341 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d63268f1-a718-4635-ae94-49804b732c79 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:59.211140 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d63268f1-a718-4635-ae94-49804b732c79 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:59.211685 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d63268f1-a718-4635-ae94-49804b732c79 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:59.212494 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d63268f1-a718-4635-ae94-49804b732c79 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:59.213092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d63268f1-a718-4635-ae94-49804b732c79 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:59.213939 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d63268f1-a718-4635-ae94-49804b732c79 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:59.309036 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d63268f1-a718-4635-ae94-49804b732c79 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:11:59.313718 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d63268f1-a718-4635-ae94-49804b732c79 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1266 microversion: 2.1 time: 0.114723 Aug 30 01:11:59.314340 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 115/239] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:59 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:11:59.821557 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c9ebea71-6734-475a-ae50-c9fec60821d8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:11:59.832017 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c9ebea71-6734-475a-ae50-c9fec60821d8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:11:59.839567 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=100 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:11:59.841287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c9ebea71-6734-475a-ae50-c9fec60821d8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:59.842274 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c9ebea71-6734-475a-ae50-c9fec60821d8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:59.842977 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c9ebea71-6734-475a-ae50-c9fec60821d8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:59.844309 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c9ebea71-6734-475a-ae50-c9fec60821d8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:59.844922 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c9ebea71-6734-475a-ae50-c9fec60821d8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:59.845505 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c9ebea71-6734-475a-ae50-c9fec60821d8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:59.928291 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-6c0f9221-c115-4f6a-ae9b-da988ed72f26 req-8c7440f0-259c-4a80-998d-2a7dafdc0ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aec6af1b-90af-41d0-9778-9c0d89e330bc", "tag": "66ac913d-aad3-451a-96e1-8f106967b9a5"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:11:59.943271 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-6c0f9221-c115-4f6a-ae9b-da988ed72f26 req-8c7440f0-259c-4a80-998d-2a7dafdc0ca1 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:11:59.943751 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-6c0f9221-c115-4f6a-ae9b-da988ed72f26 req-8c7440f0-259c-4a80-998d-2a7dafdc0ca1 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:11:59.944222 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-6c0f9221-c115-4f6a-ae9b-da988ed72f26 req-8c7440f0-259c-4a80-998d-2a7dafdc0ca1 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:11:59.959299 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-6c0f9221-c115-4f6a-ae9b-da988ed72f26 req-8c7440f0-259c-4a80-998d-2a7dafdc0ca1 service nova] Creating event network-changed:66ac913d-aad3-451a-96e1-8f106967b9a5 for instance aec6af1b-90af-41d0-9778-9c0d89e330bc on hv-cinder-81571 Aug 30 01:11:59.965589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-6c0f9221-c115-4f6a-ae9b-da988ed72f26 req-8c7440f0-259c-4a80-998d-2a7dafdc0ca1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040820 Aug 30 01:11:59.966463 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 116/240] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:12:00.073291 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c9ebea71-6734-475a-ae50-c9fec60821d8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:00.084902 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c9ebea71-6734-475a-ae50-c9fec60821d8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.272824 Aug 30 01:12:00.089783 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 125/241] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:11:59 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:00.278369 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dbae13b4-9a97-45ec-95c3-454d9eb6dfc3 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:00.279670 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dbae13b4-9a97-45ec-95c3-454d9eb6dfc3 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:00.288517 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbae13b4-9a97-45ec-95c3-454d9eb6dfc3 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:00.289282 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbae13b4-9a97-45ec-95c3-454d9eb6dfc3 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:00.289986 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbae13b4-9a97-45ec-95c3-454d9eb6dfc3 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:00.290876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbae13b4-9a97-45ec-95c3-454d9eb6dfc3 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:00.291533 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbae13b4-9a97-45ec-95c3-454d9eb6dfc3 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:00.292128 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbae13b4-9a97-45ec-95c3-454d9eb6dfc3 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:00.336078 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b18fa809-e796-419c-bd45-b2f9b37f4388 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:00.336710 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b18fa809-e796-419c-bd45-b2f9b37f4388 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:00.346977 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b18fa809-e796-419c-bd45-b2f9b37f4388 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:00.348102 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b18fa809-e796-419c-bd45-b2f9b37f4388 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:00.348982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b18fa809-e796-419c-bd45-b2f9b37f4388 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:00.350008 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b18fa809-e796-419c-bd45-b2f9b37f4388 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:00.351146 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b18fa809-e796-419c-bd45-b2f9b37f4388 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:00.351895 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b18fa809-e796-419c-bd45-b2f9b37f4388 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:00.353437 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dbae13b4-9a97-45ec-95c3-454d9eb6dfc3 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:12:00.439171 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-b18fa809-e796-419c-bd45-b2f9b37f4388 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:00.453651 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-b18fa809-e796-419c-bd45-b2f9b37f4388 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1284 microversion: 2.1 time: 0.121924 Aug 30 01:12:00.456423 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 126/242] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:00 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:00.860384 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dbae13b4-9a97-45ec-95c3-454d9eb6dfc3 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "DELETE /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 204 len: 0 microversion: 2.1 time: 0.586504 Aug 30 01:12:00.861500 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 117/243] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:12:00 2022] DELETE /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:12:00.878485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-66157d95-3189-430b-b627-55f1e25b9c78 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:00.879716 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-66157d95-3189-430b-b627-55f1e25b9c78 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:00.891423 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-66157d95-3189-430b-b627-55f1e25b9c78 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:00.897956 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-66157d95-3189-430b-b627-55f1e25b9c78 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:00.897956 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-66157d95-3189-430b-b627-55f1e25b9c78 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:00.897956 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-66157d95-3189-430b-b627-55f1e25b9c78 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:00.897956 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-66157d95-3189-430b-b627-55f1e25b9c78 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:00.898800 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-66157d95-3189-430b-b627-55f1e25b9c78 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:01.108365 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2c9adf30-feaa-4ec0-a79f-097a76289749 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:01.109065 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2c9adf30-feaa-4ec0-a79f-097a76289749 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:01.115909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-66157d95-3189-430b-b627-55f1e25b9c78 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:01.117339 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c9adf30-feaa-4ec0-a79f-097a76289749 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:01.118000 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c9adf30-feaa-4ec0-a79f-097a76289749 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:01.118287 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c9adf30-feaa-4ec0-a79f-097a76289749 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:01.119176 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c9adf30-feaa-4ec0-a79f-097a76289749 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:01.119773 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c9adf30-feaa-4ec0-a79f-097a76289749 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:01.120355 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c9adf30-feaa-4ec0-a79f-097a76289749 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:01.129171 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-66157d95-3189-430b-b627-55f1e25b9c78 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1552 microversion: 2.1 time: 0.256718 Aug 30 01:12:01.129790 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 127/244] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:00 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1552 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:01.149491 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:01.420173 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2c9adf30-feaa-4ec0-a79f-097a76289749 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:01.429534 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2c9adf30-feaa-4ec0-a79f-097a76289749 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.325290 Aug 30 01:12:01.430899 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 118/245] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:01 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:01.492484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-255d74bf-84e5-4d35-8397-4172e54d99c4 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:01.493354 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-255d74bf-84e5-4d35-8397-4172e54d99c4 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:01.510743 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-255d74bf-84e5-4d35-8397-4172e54d99c4 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:01.511261 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-255d74bf-84e5-4d35-8397-4172e54d99c4 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:01.513439 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-255d74bf-84e5-4d35-8397-4172e54d99c4 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:01.514347 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-255d74bf-84e5-4d35-8397-4172e54d99c4 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:01.514807 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-255d74bf-84e5-4d35-8397-4172e54d99c4 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:01.515579 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-255d74bf-84e5-4d35-8397-4172e54d99c4 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:01.683268 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-255d74bf-84e5-4d35-8397-4172e54d99c4 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:01.691974 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-255d74bf-84e5-4d35-8397-4172e54d99c4 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1314 microversion: 2.1 time: 0.210829 Aug 30 01:12:01.692566 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 128/246] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:01 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:02.151253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7c232b20-b8eb-4fd8-ab13-1bf415107cfe tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:02.151854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7c232b20-b8eb-4fd8-ab13-1bf415107cfe tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:02.158784 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7c232b20-b8eb-4fd8-ab13-1bf415107cfe tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:02.159266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7c232b20-b8eb-4fd8-ab13-1bf415107cfe tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:02.159699 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7c232b20-b8eb-4fd8-ab13-1bf415107cfe tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:02.160375 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7c232b20-b8eb-4fd8-ab13-1bf415107cfe tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:02.160828 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7c232b20-b8eb-4fd8-ab13-1bf415107cfe tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:02.161245 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7c232b20-b8eb-4fd8-ab13-1bf415107cfe tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:02.307829 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7c232b20-b8eb-4fd8-ab13-1bf415107cfe tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:02.319742 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7c232b20-b8eb-4fd8-ab13-1bf415107cfe tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1552 microversion: 2.1 time: 0.172561 Aug 30 01:12:02.329939 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 119/247] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:02 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1552 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:02.453069 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a1c63fb8-ed19-49af-981e-9b2142d197d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:02.454224 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a1c63fb8-ed19-49af-981e-9b2142d197d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:02.462043 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a1c63fb8-ed19-49af-981e-9b2142d197d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:02.462668 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a1c63fb8-ed19-49af-981e-9b2142d197d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:02.463222 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a1c63fb8-ed19-49af-981e-9b2142d197d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:02.464334 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a1c63fb8-ed19-49af-981e-9b2142d197d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:02.464911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a1c63fb8-ed19-49af-981e-9b2142d197d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:02.466022 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a1c63fb8-ed19-49af-981e-9b2142d197d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:02.632154 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a1c63fb8-ed19-49af-981e-9b2142d197d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:02.641005 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a1c63fb8-ed19-49af-981e-9b2142d197d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.192345 Aug 30 01:12:02.646200 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 129/248] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:02 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:02.717222 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1ab7db90-0644-4f1f-817e-be7165976775 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:02.718058 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1ab7db90-0644-4f1f-817e-be7165976775 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:02.724806 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ab7db90-0644-4f1f-817e-be7165976775 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:02.725439 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ab7db90-0644-4f1f-817e-be7165976775 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:02.725979 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ab7db90-0644-4f1f-817e-be7165976775 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:02.726741 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ab7db90-0644-4f1f-817e-be7165976775 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:02.727390 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ab7db90-0644-4f1f-817e-be7165976775 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:02.728085 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1ab7db90-0644-4f1f-817e-be7165976775 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:02.888023 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1ab7db90-0644-4f1f-817e-be7165976775 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:02.895826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1ab7db90-0644-4f1f-817e-be7165976775 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1314 microversion: 2.1 time: 0.183310 Aug 30 01:12:02.896398 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 120/249] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:02 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:03.340396 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-07ffbbbd-0a6b-4fbd-bb51-c90b4bfd20d0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:03.341379 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-07ffbbbd-0a6b-4fbd-bb51-c90b4bfd20d0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:03.347614 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07ffbbbd-0a6b-4fbd-bb51-c90b4bfd20d0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:03.348095 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07ffbbbd-0a6b-4fbd-bb51-c90b4bfd20d0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:03.354609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07ffbbbd-0a6b-4fbd-bb51-c90b4bfd20d0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:03.354609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07ffbbbd-0a6b-4fbd-bb51-c90b4bfd20d0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:03.354609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07ffbbbd-0a6b-4fbd-bb51-c90b4bfd20d0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:03.354609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07ffbbbd-0a6b-4fbd-bb51-c90b4bfd20d0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:03.525285 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-07ffbbbd-0a6b-4fbd-bb51-c90b4bfd20d0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:03.535037 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-07ffbbbd-0a6b-4fbd-bb51-c90b4bfd20d0 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1552 microversion: 2.1 time: 0.198500 Aug 30 01:12:03.535838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 130/250] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:03 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1552 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:03.663458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-228a0400-724c-4202-a567-51a2113c77e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:03.664211 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-228a0400-724c-4202-a567-51a2113c77e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:03.666537 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:03.672789 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-228a0400-724c-4202-a567-51a2113c77e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:03.674073 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-228a0400-724c-4202-a567-51a2113c77e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:03.674073 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-228a0400-724c-4202-a567-51a2113c77e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:03.674629 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-228a0400-724c-4202-a567-51a2113c77e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:03.675162 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-228a0400-724c-4202-a567-51a2113c77e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:03.675717 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-228a0400-724c-4202-a567-51a2113c77e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:03.873183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-228a0400-724c-4202-a567-51a2113c77e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:03.880970 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-228a0400-724c-4202-a567-51a2113c77e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.221642 Aug 30 01:12:03.881540 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 121/251] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:03 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:03.916384 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-fe39266b-a76d-412e-9f19-87611aac1c6b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:03.917263 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-fe39266b-a76d-412e-9f19-87611aac1c6b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:03.932524 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fe39266b-a76d-412e-9f19-87611aac1c6b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:03.933025 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fe39266b-a76d-412e-9f19-87611aac1c6b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:03.933518 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fe39266b-a76d-412e-9f19-87611aac1c6b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:03.935182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fe39266b-a76d-412e-9f19-87611aac1c6b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:03.935651 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fe39266b-a76d-412e-9f19-87611aac1c6b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:03.936419 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fe39266b-a76d-412e-9f19-87611aac1c6b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:03.957571 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-b8e1f660-ce7b-429e-ac43-ac01ccb94252 req-8323f30d-a34e-475f-912a-44d21b45a28b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b27c77-eb0e-4f06-93c6-938164beab95", "tag": "43d9e02b-7717-4924-a8e1-a1ae4be2adc5"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:12:03.978600 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-b8e1f660-ce7b-429e-ac43-ac01ccb94252 req-8323f30d-a34e-475f-912a-44d21b45a28b service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:03.979078 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-b8e1f660-ce7b-429e-ac43-ac01ccb94252 req-8323f30d-a34e-475f-912a-44d21b45a28b service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:03.979511 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-b8e1f660-ce7b-429e-ac43-ac01ccb94252 req-8323f30d-a34e-475f-912a-44d21b45a28b service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:03.997257 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-b8e1f660-ce7b-429e-ac43-ac01ccb94252 req-8323f30d-a34e-475f-912a-44d21b45a28b service nova] Creating event network-changed:43d9e02b-7717-4924-a8e1-a1ae4be2adc5 for instance 95b27c77-eb0e-4f06-93c6-938164beab95 on hv-cinder-81571 Aug 30 01:12:04.004425 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-b8e1f660-ce7b-429e-ac43-ac01ccb94252 req-8323f30d-a34e-475f-912a-44d21b45a28b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053355 Aug 30 01:12:04.005048 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 122/252] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:12:04.159591 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-fe39266b-a76d-412e-9f19-87611aac1c6b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:04.166051 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=100 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:04.168922 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-fe39266b-a76d-412e-9f19-87611aac1c6b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1314 microversion: 2.1 time: 0.256390 Aug 30 01:12:04.169910 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 131/253] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:03 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:04.557267 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5c4f35a6-cf5d-4bdd-98cd-c5c88618812b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:04.558155 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5c4f35a6-cf5d-4bdd-98cd-c5c88618812b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:04.565381 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c4f35a6-cf5d-4bdd-98cd-c5c88618812b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:04.565924 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c4f35a6-cf5d-4bdd-98cd-c5c88618812b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:04.566396 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c4f35a6-cf5d-4bdd-98cd-c5c88618812b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:04.567093 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c4f35a6-cf5d-4bdd-98cd-c5c88618812b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:04.567548 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c4f35a6-cf5d-4bdd-98cd-c5c88618812b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:04.568007 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c4f35a6-cf5d-4bdd-98cd-c5c88618812b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:04.635084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=10 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:04.906599 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-bc8ce484-06a5-4d8d-b689-925bfd8d3f89 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:04.915660 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-bc8ce484-06a5-4d8d-b689-925bfd8d3f89 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:04.917092 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc8ce484-06a5-4d8d-b689-925bfd8d3f89 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:04.917649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc8ce484-06a5-4d8d-b689-925bfd8d3f89 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:04.918884 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc8ce484-06a5-4d8d-b689-925bfd8d3f89 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:04.920075 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc8ce484-06a5-4d8d-b689-925bfd8d3f89 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:04.920752 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc8ce484-06a5-4d8d-b689-925bfd8d3f89 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:04.921385 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc8ce484-06a5-4d8d-b689-925bfd8d3f89 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:05.112051 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-bc8ce484-06a5-4d8d-b689-925bfd8d3f89 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:05.125845 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-bc8ce484-06a5-4d8d-b689-925bfd8d3f89 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.226966 Aug 30 01:12:05.136215 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 132/254] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:04 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:05.157046 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5c4f35a6-cf5d-4bdd-98cd-c5c88618812b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:05.167490 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5c4f35a6-cf5d-4bdd-98cd-c5c88618812b tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1552 microversion: 2.1 time: 0.614492 Aug 30 01:12:05.171900 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 123/255] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:04 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1552 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:05.190522 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-608b4e58-3f9a-4bf0-aa81-4a3721458458 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:05.191130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-608b4e58-3f9a-4bf0-aa81-4a3721458458 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:05.197034 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-608b4e58-3f9a-4bf0-aa81-4a3721458458 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:05.197529 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-608b4e58-3f9a-4bf0-aa81-4a3721458458 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:05.198006 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-608b4e58-3f9a-4bf0-aa81-4a3721458458 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:05.198711 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-608b4e58-3f9a-4bf0-aa81-4a3721458458 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:05.199162 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-608b4e58-3f9a-4bf0-aa81-4a3721458458 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:05.199663 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-608b4e58-3f9a-4bf0-aa81-4a3721458458 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:05.386009 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-608b4e58-3f9a-4bf0-aa81-4a3721458458 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:05.394925 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-608b4e58-3f9a-4bf0-aa81-4a3721458458 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1314 microversion: 2.1 time: 0.208129 Aug 30 01:12:05.406360 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 133/256] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:05 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:06.023462 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-bdbb355c-d75a-46c5-83d6-f3f2c63b4218 req-17a35d8c-e42d-4275-af36-6ca3ba2bdc3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30841f5c-b634-47dc-97ab-c651bf3ace8a", "name": "network-vif-deleted", "tag": "d8d36366-3bec-4323-a577-34ce2e4beafd"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:12:06.033472 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-bdbb355c-d75a-46c5-83d6-f3f2c63b4218 req-17a35d8c-e42d-4275-af36-6ca3ba2bdc3e service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:06.033967 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-bdbb355c-d75a-46c5-83d6-f3f2c63b4218 req-17a35d8c-e42d-4275-af36-6ca3ba2bdc3e service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:06.034392 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-bdbb355c-d75a-46c5-83d6-f3f2c63b4218 req-17a35d8c-e42d-4275-af36-6ca3ba2bdc3e service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:06.045573 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-bdbb355c-d75a-46c5-83d6-f3f2c63b4218 req-17a35d8c-e42d-4275-af36-6ca3ba2bdc3e service nova] Creating event network-vif-deleted:d8d36366-3bec-4323-a577-34ce2e4beafd for instance 30841f5c-b634-47dc-97ab-c651bf3ace8a on hv-cinder-81571 Aug 30 01:12:06.050935 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-bdbb355c-d75a-46c5-83d6-f3f2c63b4218 req-17a35d8c-e42d-4275-af36-6ca3ba2bdc3e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031661 Aug 30 01:12:06.051716 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 124/257] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:12:06.150745 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-bf64c139-5691-4ff2-98d6-ddee0bf4b8bf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:06.150745 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-bf64c139-5691-4ff2-98d6-ddee0bf4b8bf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:06.156748 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bf64c139-5691-4ff2-98d6-ddee0bf4b8bf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:06.157475 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bf64c139-5691-4ff2-98d6-ddee0bf4b8bf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:06.157916 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bf64c139-5691-4ff2-98d6-ddee0bf4b8bf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:06.158838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bf64c139-5691-4ff2-98d6-ddee0bf4b8bf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:06.159473 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bf64c139-5691-4ff2-98d6-ddee0bf4b8bf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:06.160138 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bf64c139-5691-4ff2-98d6-ddee0bf4b8bf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:06.192914 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8c68876e-28d1-4a3d-bea3-0eb50b5e0a82 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:06.193874 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8c68876e-28d1-4a3d-bea3-0eb50b5e0a82 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:06.202699 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c68876e-28d1-4a3d-bea3-0eb50b5e0a82 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:06.203290 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c68876e-28d1-4a3d-bea3-0eb50b5e0a82 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:06.203811 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c68876e-28d1-4a3d-bea3-0eb50b5e0a82 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:06.204579 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c68876e-28d1-4a3d-bea3-0eb50b5e0a82 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:06.205105 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c68876e-28d1-4a3d-bea3-0eb50b5e0a82 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:06.205619 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c68876e-28d1-4a3d-bea3-0eb50b5e0a82 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:06.284939 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8c68876e-28d1-4a3d-bea3-0eb50b5e0a82 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:06.298319 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8c68876e-28d1-4a3d-bea3-0eb50b5e0a82 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1344 microversion: 2.1 time: 0.108093 Aug 30 01:12:06.300032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 125/258] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:06 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1344 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:06.310756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-bf64c139-5691-4ff2-98d6-ddee0bf4b8bf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:06.319484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-bf64c139-5691-4ff2-98d6-ddee0bf4b8bf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.174896 Aug 30 01:12:06.333134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 134/259] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:06 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:06.416513 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0849be53-1f6b-4aa1-a5a1-1854a1100792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:06.417043 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0849be53-1f6b-4aa1-a5a1-1854a1100792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:06.424045 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0849be53-1f6b-4aa1-a5a1-1854a1100792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:06.424537 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0849be53-1f6b-4aa1-a5a1-1854a1100792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:06.424981 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0849be53-1f6b-4aa1-a5a1-1854a1100792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:06.425675 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0849be53-1f6b-4aa1-a5a1-1854a1100792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:06.426196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0849be53-1f6b-4aa1-a5a1-1854a1100792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:06.426626 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0849be53-1f6b-4aa1-a5a1-1854a1100792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:06.580613 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0849be53-1f6b-4aa1-a5a1-1854a1100792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:06.588708 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0849be53-1f6b-4aa1-a5a1-1854a1100792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1314 microversion: 2.1 time: 0.176193 Aug 30 01:12:06.589299 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 126/260] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:06 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:07.322117 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4de50a2d-431e-40b6-92eb-5898b14aab05 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:07.322993 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4de50a2d-431e-40b6-92eb-5898b14aab05 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:07.333614 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4de50a2d-431e-40b6-92eb-5898b14aab05 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:07.336289 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4de50a2d-431e-40b6-92eb-5898b14aab05 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:07.336755 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4de50a2d-431e-40b6-92eb-5898b14aab05 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:07.338571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4de50a2d-431e-40b6-92eb-5898b14aab05 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:07.340350 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4de50a2d-431e-40b6-92eb-5898b14aab05 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:07.343091 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4de50a2d-431e-40b6-92eb-5898b14aab05 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:07.344547 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5d2925f5-9d2d-49b2-9a76-83af17b17dc8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:07.347304 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5d2925f5-9d2d-49b2-9a76-83af17b17dc8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:07.355327 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d2925f5-9d2d-49b2-9a76-83af17b17dc8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:07.356372 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d2925f5-9d2d-49b2-9a76-83af17b17dc8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:07.357138 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d2925f5-9d2d-49b2-9a76-83af17b17dc8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:07.357969 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d2925f5-9d2d-49b2-9a76-83af17b17dc8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:07.358623 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d2925f5-9d2d-49b2-9a76-83af17b17dc8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:07.359148 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d2925f5-9d2d-49b2-9a76-83af17b17dc8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:07.381624 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4de50a2d-431e-40b6-92eb-5898b14aab05 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:07.382384 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4de50a2d-431e-40b6-92eb-5898b14aab05 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:07.382930 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4de50a2d-431e-40b6-92eb-5898b14aab05 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:07.383714 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-4de50a2d-431e-40b6-92eb-5898b14aab05 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lazy-loading 'fault' on Instance uuid 30841f5c-b634-47dc-97ab-c651bf3ace8a {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:12:07.439020 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4de50a2d-431e-40b6-92eb-5898b14aab05 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:07.448547 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4de50a2d-431e-40b6-92eb-5898b14aab05 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1349 microversion: 2.1 time: 0.130576 Aug 30 01:12:07.449147 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 135/261] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:07 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1349 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:07.556471 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5d2925f5-9d2d-49b2-9a76-83af17b17dc8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:07.566555 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5d2925f5-9d2d-49b2-9a76-83af17b17dc8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.228715 Aug 30 01:12:07.567136 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 127/262] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:07 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:07.610409 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-293ef94f-1636-432d-9481-a2c1dce2cd77 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:07.611276 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-293ef94f-1636-432d-9481-a2c1dce2cd77 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:07.617878 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-293ef94f-1636-432d-9481-a2c1dce2cd77 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:07.618499 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-293ef94f-1636-432d-9481-a2c1dce2cd77 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:07.618937 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-293ef94f-1636-432d-9481-a2c1dce2cd77 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:07.620073 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-293ef94f-1636-432d-9481-a2c1dce2cd77 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:07.620530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-293ef94f-1636-432d-9481-a2c1dce2cd77 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:07.622881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-293ef94f-1636-432d-9481-a2c1dce2cd77 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:07.772396 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-293ef94f-1636-432d-9481-a2c1dce2cd77 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:07.781038 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-293ef94f-1636-432d-9481-a2c1dce2cd77 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1314 microversion: 2.1 time: 0.175221 Aug 30 01:12:07.782168 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 136/263] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:07 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:08.476236 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f09fbae2-e5fe-45dd-91fd-61c5fb38676e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:08.477449 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f09fbae2-e5fe-45dd-91fd-61c5fb38676e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:08.484075 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f09fbae2-e5fe-45dd-91fd-61c5fb38676e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:08.484567 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f09fbae2-e5fe-45dd-91fd-61c5fb38676e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:08.499987 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f09fbae2-e5fe-45dd-91fd-61c5fb38676e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:08.499987 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f09fbae2-e5fe-45dd-91fd-61c5fb38676e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:08.499987 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f09fbae2-e5fe-45dd-91fd-61c5fb38676e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:08.499987 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f09fbae2-e5fe-45dd-91fd-61c5fb38676e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:08.520333 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f09fbae2-e5fe-45dd-91fd-61c5fb38676e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:08.520824 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f09fbae2-e5fe-45dd-91fd-61c5fb38676e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:08.521260 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f09fbae2-e5fe-45dd-91fd-61c5fb38676e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:08.521740 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-f09fbae2-e5fe-45dd-91fd-61c5fb38676e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lazy-loading 'fault' on Instance uuid 30841f5c-b634-47dc-97ab-c651bf3ace8a {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:12:08.568031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f09fbae2-e5fe-45dd-91fd-61c5fb38676e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13848c47ddd9441282bec982cccc8b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f082e13ad014501b7a781167ddb2ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:08.577974 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f09fbae2-e5fe-45dd-91fd-61c5fb38676e tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 200 len: 1303 microversion: 2.1 time: 0.103624 Aug 30 01:12:08.582732 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 128/264] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:08 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:08.591348 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2278e213-336d-44b3-bee4-9c0617f5943b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:08.593094 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2278e213-336d-44b3-bee4-9c0617f5943b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:08.600646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2278e213-336d-44b3-bee4-9c0617f5943b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:08.601143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2278e213-336d-44b3-bee4-9c0617f5943b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:08.601577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2278e213-336d-44b3-bee4-9c0617f5943b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:08.602372 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2278e213-336d-44b3-bee4-9c0617f5943b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:08.602796 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2278e213-336d-44b3-bee4-9c0617f5943b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:08.603228 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2278e213-336d-44b3-bee4-9c0617f5943b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:08.734348 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2278e213-336d-44b3-bee4-9c0617f5943b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:08.742113 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2278e213-336d-44b3-bee4-9c0617f5943b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.155317 Aug 30 01:12:08.743471 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 137/265] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:08 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:08.803935 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-10ea6a6c-4c0b-41d2-be99-67084b1877b0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:08.804664 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-10ea6a6c-4c0b-41d2-be99-67084b1877b0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:08.811536 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10ea6a6c-4c0b-41d2-be99-67084b1877b0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:08.812108 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10ea6a6c-4c0b-41d2-be99-67084b1877b0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:08.812632 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10ea6a6c-4c0b-41d2-be99-67084b1877b0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:08.815033 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10ea6a6c-4c0b-41d2-be99-67084b1877b0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:08.815033 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10ea6a6c-4c0b-41d2-be99-67084b1877b0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:08.815033 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10ea6a6c-4c0b-41d2-be99-67084b1877b0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:08.952658 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-10ea6a6c-4c0b-41d2-be99-67084b1877b0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:08.960538 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-10ea6a6c-4c0b-41d2-be99-67084b1877b0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1314 microversion: 2.1 time: 0.160711 Aug 30 01:12:08.961164 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 129/266] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:08 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:09.600251 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-44b1c435-db4d-4d62-af3d-72d4efd51402 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:09.600860 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-44b1c435-db4d-4d62-af3d-72d4efd51402 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:09.607217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-44b1c435-db4d-4d62-af3d-72d4efd51402 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:09.607805 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-44b1c435-db4d-4d62-af3d-72d4efd51402 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:09.608264 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-44b1c435-db4d-4d62-af3d-72d4efd51402 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:09.608960 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-44b1c435-db4d-4d62-af3d-72d4efd51402 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:09.609411 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-44b1c435-db4d-4d62-af3d-72d4efd51402 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:09.609856 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-44b1c435-db4d-4d62-af3d-72d4efd51402 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:09.623912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-44b1c435-db4d-4d62-af3d-72d4efd51402 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] HTTP exception thrown: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-44b1c435-db4d-4d62-af3d-72d4efd51402 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Request method failure captured: Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a HTTP/1.1 Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOjr6Qbq-NZm2gurkOlxK4bhs0YdMRqDUCNhkbv73VQnfUcqIJ7NoC9984e3rR-BLi-aAbUduU_7g7ejUqKXkNN0oaupGgJ_Yb7voDNQGg4g5_lSVAl242gAaCmPv9tSsHthhXiLeR-0HeVWkAz_jVSZ2T0XJOMvi4zoKdSW0mu1sM Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 4f082e13ad014501b7a781167ddb2ed8 Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-DeleteServersTestJSON-406149098 Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:12:09.628605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:12:09.630190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f082e13ad014501b7a781167ddb2ed8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f082e13ad014501b7a781167ddb2ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f082e13ad014501b7a781167ddb2ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f082e13ad014501b7a781167ddb2ed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:12:09.630190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-DeleteServersTestJSON-406149098 Aug 30 01:12:09.630190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 4f082e13ad014501b7a781167ddb2ed8 Aug 30 01:12:09.630190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-DeleteServersTestJSON-406149098 Aug 30 01:12:09.630190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-DeleteServersTestJSON-406149098-project Aug 30 01:12:09.630190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:12:09.630190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:12:09.630190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 13848c47ddd9441282bec982cccc8b91 Aug 30 01:12:09.630190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-DeleteServersTestJSON-406149098-project Aug 30 01:12:09.630190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:12:09.630190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:09.630190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': '30841f5c-b634-47dc-97ab-c651bf3ace8a'} Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:12:09.631104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:09.632629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:09.633996 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-44b1c435-db4d-4d62-af3d-72d4efd51402 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Returning 404 to user: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:12:09.633996 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-44b1c435-db4d-4d62-af3d-72d4efd51402 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 404 len: 111 microversion: 2.1 time: 0.033703 Aug 30 01:12:09.633996 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 138/267] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:09 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:12:09.749431 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e95ca0d4-5ced-4809-a9c5-4045e51726ad tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:09.751725 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e95ca0d4-5ced-4809-a9c5-4045e51726ad tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:09.757913 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e95ca0d4-5ced-4809-a9c5-4045e51726ad tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:09.758391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e95ca0d4-5ced-4809-a9c5-4045e51726ad tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:09.759012 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e95ca0d4-5ced-4809-a9c5-4045e51726ad tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:09.759886 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e95ca0d4-5ced-4809-a9c5-4045e51726ad tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:09.760341 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e95ca0d4-5ced-4809-a9c5-4045e51726ad tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:09.760764 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e95ca0d4-5ced-4809-a9c5-4045e51726ad tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:09.767983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-fb2786f5-5c96-4455-ab95-a28b3cb68ca7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:09.768915 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-fb2786f5-5c96-4455-ab95-a28b3cb68ca7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:09.776229 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-e95ca0d4-5ced-4809-a9c5-4045e51726ad tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] HTTP exception thrown: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:09.786115 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fb2786f5-5c96-4455-ab95-a28b3cb68ca7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:09.786115 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fb2786f5-5c96-4455-ab95-a28b3cb68ca7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e95ca0d4-5ced-4809-a9c5-4045e51726ad tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Request method failure captured: Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a/os-volume_attachments HTTP/1.1 Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWOjr6Qbq-NZm2gurkOlxK4bhs0YdMRqDUCNhkbv73VQnfUcqIJ7NoC9984e3rR-BLi-aAbUduU_7g7ejUqKXkNN0oaupGgJ_Yb7voDNQGg4g5_lSVAl242gAaCmPv9tSsHthhXiLeR-0HeVWkAz_jVSZ2T0XJOMvi4zoKdSW0mu1sM Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 4f082e13ad014501b7a781167ddb2ed8 Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-DeleteServersTestJSON-406149098 Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:12:09.786391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:12:09.787770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f082e13ad014501b7a781167ddb2ed8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f082e13ad014501b7a781167ddb2ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f082e13ad014501b7a781167ddb2ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f082e13ad014501b7a781167ddb2ed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:12:09.787770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-DeleteServersTestJSON-406149098 Aug 30 01:12:09.787770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 4f082e13ad014501b7a781167ddb2ed8 Aug 30 01:12:09.787770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-DeleteServersTestJSON-406149098 Aug 30 01:12:09.787770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-DeleteServersTestJSON-406149098-project Aug 30 01:12:09.787770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:12:09.787770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:12:09.787770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 13848c47ddd9441282bec982cccc8b91 Aug 30 01:12:09.787770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-DeleteServersTestJSON-406149098-project Aug 30 01:12:09.787770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:12:09.787770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:09.787770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'server_id': '30841f5c-b634-47dc-97ab-c651bf3ace8a'} Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:12:09.788556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:09.790927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:12:09.794497 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fb2786f5-5c96-4455-ab95-a28b3cb68ca7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:09.794676 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e95ca0d4-5ced-4809-a9c5-4045e51726ad tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Returning 404 to user: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:12:09.794830 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fb2786f5-5c96-4455-ab95-a28b3cb68ca7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:09.795164 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e95ca0d4-5ced-4809-a9c5-4045e51726ad tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039014 Aug 30 01:12:09.795315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fb2786f5-5c96-4455-ab95-a28b3cb68ca7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:09.795421 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 130/268] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:12:09 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:12:09.795563 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fb2786f5-5c96-4455-ab95-a28b3cb68ca7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:09.940305 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-fb2786f5-5c96-4455-ab95-a28b3cb68ca7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:09.948170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-fb2786f5-5c96-4455-ab95-a28b3cb68ca7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.187905 Aug 30 01:12:09.948848 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 139/269] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:09 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:09.981518 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cc499254-553e-43b0-9be0-187937ff17db tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:09.982727 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cc499254-553e-43b0-9be0-187937ff17db tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:09.988923 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc499254-553e-43b0-9be0-187937ff17db tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:09.989403 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc499254-553e-43b0-9be0-187937ff17db tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:09.989866 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc499254-553e-43b0-9be0-187937ff17db tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:09.990553 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc499254-553e-43b0-9be0-187937ff17db tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:09.991003 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc499254-553e-43b0-9be0-187937ff17db tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:09.991422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc499254-553e-43b0-9be0-187937ff17db tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:10.134030 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cc499254-553e-43b0-9be0-187937ff17db tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:10.141702 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cc499254-553e-43b0-9be0-187937ff17db tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1314 microversion: 2.1 time: 0.164027 Aug 30 01:12:10.142305 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 131/270] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:09 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:10.972500 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a3475c35-d46d-4a28-88a1-a326d17fe802 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:10.973136 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a3475c35-d46d-4a28-88a1-a326d17fe802 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:10.983187 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a3475c35-d46d-4a28-88a1-a326d17fe802 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:10.984338 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a3475c35-d46d-4a28-88a1-a326d17fe802 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:10.984791 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a3475c35-d46d-4a28-88a1-a326d17fe802 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:10.985934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a3475c35-d46d-4a28-88a1-a326d17fe802 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:10.986401 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a3475c35-d46d-4a28-88a1-a326d17fe802 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:10.986883 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a3475c35-d46d-4a28-88a1-a326d17fe802 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:11.122537 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a3475c35-d46d-4a28-88a1-a326d17fe802 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:11.130337 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a3475c35-d46d-4a28-88a1-a326d17fe802 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.164399 Aug 30 01:12:11.130918 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 140/271] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:10 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:11.162180 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b4439c89-d152-48d4-b489-6126e45c22ba tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:11.162746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b4439c89-d152-48d4-b489-6126e45c22ba tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:11.168682 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4439c89-d152-48d4-b489-6126e45c22ba tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:11.169213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4439c89-d152-48d4-b489-6126e45c22ba tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:11.170255 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4439c89-d152-48d4-b489-6126e45c22ba tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:11.170937 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4439c89-d152-48d4-b489-6126e45c22ba tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:11.171391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4439c89-d152-48d4-b489-6126e45c22ba tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:11.171821 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4439c89-d152-48d4-b489-6126e45c22ba tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:11.203734 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-367088d3-4235-4714-b1e3-9a8db94a2fab tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:11.204235 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-367088d3-4235-4714-b1e3-9a8db94a2fab tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:11.211646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-367088d3-4235-4714-b1e3-9a8db94a2fab tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:11.213652 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-367088d3-4235-4714-b1e3-9a8db94a2fab tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:11.213652 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-367088d3-4235-4714-b1e3-9a8db94a2fab tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:11.213652 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-367088d3-4235-4714-b1e3-9a8db94a2fab tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:11.214067 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-367088d3-4235-4714-b1e3-9a8db94a2fab tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:11.214284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-367088d3-4235-4714-b1e3-9a8db94a2fab tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:11.229990 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-367088d3-4235-4714-b1e3-9a8db94a2fab tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] HTTP exception thrown: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-367088d3-4235-4714-b1e3-9a8db94a2fab tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Request method failure captured: Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: DELETE /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a HTTP/1.1 Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOjr6Qbq-NZm2gurkOlxK4bhs0YdMRqDUCNhkbv73VQnfUcqIJ7NoC9984e3rR-BLi-aAbUduU_7g7ejUqKXkNN0oaupGgJ_Yb7voDNQGg4g5_lSVAl242gAaCmPv9tSsHthhXiLeR-0HeVWkAz_jVSZ2T0XJOMvi4zoKdSW0mu1sM Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 4f082e13ad014501b7a781167ddb2ed8 Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-DeleteServersTestJSON-406149098 Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:12:11.231485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:12:11.233370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f082e13ad014501b7a781167ddb2ed8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f082e13ad014501b7a781167ddb2ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f082e13ad014501b7a781167ddb2ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f082e13ad014501b7a781167ddb2ed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:12:11.233370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-DeleteServersTestJSON-406149098 Aug 30 01:12:11.233370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 4f082e13ad014501b7a781167ddb2ed8 Aug 30 01:12:11.233370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-DeleteServersTestJSON-406149098 Aug 30 01:12:11.233370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-DeleteServersTestJSON-406149098-project Aug 30 01:12:11.233370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:12:11.233370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:12:11.233370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 13848c47ddd9441282bec982cccc8b91 Aug 30 01:12:11.233370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-DeleteServersTestJSON-406149098-project Aug 30 01:12:11.233370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:12:11.233370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:11.233370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': '30841f5c-b634-47dc-97ab-c651bf3ace8a'} Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:12:11.234063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:11.235128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:11.236229 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-367088d3-4235-4714-b1e3-9a8db94a2fab tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Returning 404 to user: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:12:11.236229 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-367088d3-4235-4714-b1e3-9a8db94a2fab tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "DELETE /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 404 len: 111 microversion: 2.1 time: 0.034204 Aug 30 01:12:11.236229 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 141/272] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:12:11 2022] DELETE /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:12:11.242653 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b875b94e-8acb-43e2-bf24-c1de2a1aa730 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:11.246218 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b875b94e-8acb-43e2-bf24-c1de2a1aa730 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] [instance: 30841f5c-b634-47dc-97ab-c651bf3ace8a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:11.249529 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b875b94e-8acb-43e2-bf24-c1de2a1aa730 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:11.250067 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b875b94e-8acb-43e2-bf24-c1de2a1aa730 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:11.250512 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b875b94e-8acb-43e2-bf24-c1de2a1aa730 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:11.251217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b875b94e-8acb-43e2-bf24-c1de2a1aa730 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:11.251679 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b875b94e-8acb-43e2-bf24-c1de2a1aa730 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:11.252102 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b875b94e-8acb-43e2-bf24-c1de2a1aa730 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:11.267335 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-b875b94e-8acb-43e2-bf24-c1de2a1aa730 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] HTTP exception thrown: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b875b94e-8acb-43e2-bf24-c1de2a1aa730 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Request method failure captured: Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a HTTP/1.1 Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOjr6Qbq-NZm2gurkOlxK4bhs0YdMRqDUCNhkbv73VQnfUcqIJ7NoC9984e3rR-BLi-aAbUduU_7g7ejUqKXkNN0oaupGgJ_Yb7voDNQGg4g5_lSVAl242gAaCmPv9tSsHthhXiLeR-0HeVWkAz_jVSZ2T0XJOMvi4zoKdSW0mu1sM Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 4f082e13ad014501b7a781167ddb2ed8 Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-DeleteServersTestJSON-406149098 Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:12:11.269129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:12:11.275661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f082e13ad014501b7a781167ddb2ed8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f082e13ad014501b7a781167ddb2ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f082e13ad014501b7a781167ddb2ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f082e13ad014501b7a781167ddb2ed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:12:11.275661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-DeleteServersTestJSON-406149098 Aug 30 01:12:11.275661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 4f082e13ad014501b7a781167ddb2ed8 Aug 30 01:12:11.275661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-DeleteServersTestJSON-406149098 Aug 30 01:12:11.275661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-DeleteServersTestJSON-406149098-project Aug 30 01:12:11.275661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:12:11.275661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:12:11.275661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 13848c47ddd9441282bec982cccc8b91 Aug 30 01:12:11.275661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-DeleteServersTestJSON-406149098-project Aug 30 01:12:11.275661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:12:11.275661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:11.275661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': '30841f5c-b634-47dc-97ab-c651bf3ace8a'} Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:12:11.276804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. Aug 30 01:12:11.277973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:11.279570 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b875b94e-8acb-43e2-bf24-c1de2a1aa730 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] Returning 404 to user: Instance 30841f5c-b634-47dc-97ab-c651bf3ace8a could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:12:11.279570 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-b875b94e-8acb-43e2-bf24-c1de2a1aa730 tempest-DeleteServersTestJSON-406149098 tempest-DeleteServersTestJSON-406149098-project] 10.222.0.52 "GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a" status: 404 len: 111 microversion: 2.1 time: 0.032592 Aug 30 01:12:11.279570 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 142/273] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:11 2022] GET /compute/v2.1/servers/30841f5c-b634-47dc-97ab-c651bf3ace8a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:12:11.333505 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b4439c89-d152-48d4-b489-6126e45c22ba tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:11.346650 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b4439c89-d152-48d4-b489-6126e45c22ba tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1314 microversion: 2.1 time: 0.188322 Aug 30 01:12:11.347505 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 132/274] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:11 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:11.378673 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-ae2d63e4-b85b-43bc-8b86-1b1300c6eeda req-879798b5-8f3d-45f5-838f-6520ca246df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b27c77-eb0e-4f06-93c6-938164beab95", "name": "network-vif-plugged", "status": "completed", "tag": "43d9e02b-7717-4924-a8e1-a1ae4be2adc5"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:12:11.389208 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-ae2d63e4-b85b-43bc-8b86-1b1300c6eeda req-879798b5-8f3d-45f5-838f-6520ca246df7 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:11.389683 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-ae2d63e4-b85b-43bc-8b86-1b1300c6eeda req-879798b5-8f3d-45f5-838f-6520ca246df7 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:11.390134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-ae2d63e4-b85b-43bc-8b86-1b1300c6eeda req-879798b5-8f3d-45f5-838f-6520ca246df7 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:11.402146 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-ae2d63e4-b85b-43bc-8b86-1b1300c6eeda req-879798b5-8f3d-45f5-838f-6520ca246df7 service nova] Creating event network-vif-plugged:43d9e02b-7717-4924-a8e1-a1ae4be2adc5 for instance 95b27c77-eb0e-4f06-93c6-938164beab95 on hv-cinder-81571 Aug 30 01:12:11.409282 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-ae2d63e4-b85b-43bc-8b86-1b1300c6eeda req-879798b5-8f3d-45f5-838f-6520ca246df7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034488 Aug 30 01:12:11.412877 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 143/275] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:12:12.151826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f246aadc-62f6-415c-b810-7ea672e4ab70 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:12.152773 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f246aadc-62f6-415c-b810-7ea672e4ab70 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:12.158995 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f246aadc-62f6-415c-b810-7ea672e4ab70 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:12.159732 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f246aadc-62f6-415c-b810-7ea672e4ab70 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:12.160380 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f246aadc-62f6-415c-b810-7ea672e4ab70 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:12.166127 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f246aadc-62f6-415c-b810-7ea672e4ab70 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:12.166127 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f246aadc-62f6-415c-b810-7ea672e4ab70 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:12.166127 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f246aadc-62f6-415c-b810-7ea672e4ab70 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:12.305271 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f246aadc-62f6-415c-b810-7ea672e4ab70 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:12.313682 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f246aadc-62f6-415c-b810-7ea672e4ab70 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.165635 Aug 30 01:12:12.314295 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 133/276] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:12 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:12.371320 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-632aaba7-d0ce-4ecf-88e1-18194fe2bc03 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:12.373333 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-632aaba7-d0ce-4ecf-88e1-18194fe2bc03 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:12.380077 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-632aaba7-d0ce-4ecf-88e1-18194fe2bc03 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:12.380559 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-632aaba7-d0ce-4ecf-88e1-18194fe2bc03 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:12.381004 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-632aaba7-d0ce-4ecf-88e1-18194fe2bc03 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:12.381696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-632aaba7-d0ce-4ecf-88e1-18194fe2bc03 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:12.382179 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-632aaba7-d0ce-4ecf-88e1-18194fe2bc03 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:12.382602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-632aaba7-d0ce-4ecf-88e1-18194fe2bc03 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:12.687783 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-632aaba7-d0ce-4ecf-88e1-18194fe2bc03 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:12.705459 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-632aaba7-d0ce-4ecf-88e1-18194fe2bc03 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1314 microversion: 2.1 time: 0.340603 Aug 30 01:12:12.707150 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 144/277] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:12 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:13.335867 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5d0e2e36-7013-47b6-a505-ffd8f8471506 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:13.337647 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5d0e2e36-7013-47b6-a505-ffd8f8471506 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:13.344303 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d0e2e36-7013-47b6-a505-ffd8f8471506 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:13.345376 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d0e2e36-7013-47b6-a505-ffd8f8471506 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:13.346086 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d0e2e36-7013-47b6-a505-ffd8f8471506 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:13.350076 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d0e2e36-7013-47b6-a505-ffd8f8471506 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:13.350076 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d0e2e36-7013-47b6-a505-ffd8f8471506 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:13.350076 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d0e2e36-7013-47b6-a505-ffd8f8471506 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:13.510338 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5d0e2e36-7013-47b6-a505-ffd8f8471506 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:13.519364 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5d0e2e36-7013-47b6-a505-ffd8f8471506 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.188105 Aug 30 01:12:13.519949 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 134/278] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:13 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:13.727845 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9bcb8ae4-0461-47e4-8ad2-8b50dc100efc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:13.729152 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9bcb8ae4-0461-47e4-8ad2-8b50dc100efc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:13.736647 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bcb8ae4-0461-47e4-8ad2-8b50dc100efc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:13.738025 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bcb8ae4-0461-47e4-8ad2-8b50dc100efc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:13.738893 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bcb8ae4-0461-47e4-8ad2-8b50dc100efc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:13.739844 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bcb8ae4-0461-47e4-8ad2-8b50dc100efc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:13.740463 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bcb8ae4-0461-47e4-8ad2-8b50dc100efc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:13.741099 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bcb8ae4-0461-47e4-8ad2-8b50dc100efc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:13.950452 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9bcb8ae4-0461-47e4-8ad2-8b50dc100efc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:13.958466 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9bcb8ae4-0461-47e4-8ad2-8b50dc100efc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1314 microversion: 2.1 time: 0.234832 Aug 30 01:12:13.959027 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 145/279] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:13 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:14.540355 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-684c6fca-8edf-489d-b08a-dde81919a3a3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:14.540959 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-684c6fca-8edf-489d-b08a-dde81919a3a3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:14.547817 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-684c6fca-8edf-489d-b08a-dde81919a3a3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:14.551825 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-684c6fca-8edf-489d-b08a-dde81919a3a3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:14.551825 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-684c6fca-8edf-489d-b08a-dde81919a3a3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:14.551825 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-684c6fca-8edf-489d-b08a-dde81919a3a3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:14.551825 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-684c6fca-8edf-489d-b08a-dde81919a3a3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:14.552323 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-684c6fca-8edf-489d-b08a-dde81919a3a3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:14.705664 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-684c6fca-8edf-489d-b08a-dde81919a3a3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:14.713625 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-684c6fca-8edf-489d-b08a-dde81919a3a3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.176989 Aug 30 01:12:14.714246 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 135/280] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:14 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:14.979449 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4a644cab-57fb-47bb-b162-4b8415f207e2 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:14.980677 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4a644cab-57fb-47bb-b162-4b8415f207e2 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:14.989898 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4a644cab-57fb-47bb-b162-4b8415f207e2 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:14.990386 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4a644cab-57fb-47bb-b162-4b8415f207e2 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:14.990821 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4a644cab-57fb-47bb-b162-4b8415f207e2 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:14.991530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4a644cab-57fb-47bb-b162-4b8415f207e2 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:14.991982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4a644cab-57fb-47bb-b162-4b8415f207e2 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:14.992403 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4a644cab-57fb-47bb-b162-4b8415f207e2 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:15.187115 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4a644cab-57fb-47bb-b162-4b8415f207e2 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:15.195201 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4a644cab-57fb-47bb-b162-4b8415f207e2 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1314 microversion: 2.1 time: 0.219499 Aug 30 01:12:15.195977 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 146/281] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:14 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:15.734964 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5e1ee2c0-1fec-4540-b85c-32bbadc97d52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:15.735498 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5e1ee2c0-1fec-4540-b85c-32bbadc97d52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:15.741563 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e1ee2c0-1fec-4540-b85c-32bbadc97d52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:15.742090 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e1ee2c0-1fec-4540-b85c-32bbadc97d52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:15.742531 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e1ee2c0-1fec-4540-b85c-32bbadc97d52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:15.743220 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e1ee2c0-1fec-4540-b85c-32bbadc97d52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:15.743675 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e1ee2c0-1fec-4540-b85c-32bbadc97d52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:15.744103 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e1ee2c0-1fec-4540-b85c-32bbadc97d52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:15.880746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5e1ee2c0-1fec-4540-b85c-32bbadc97d52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:15.884241 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:15.888940 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5e1ee2c0-1fec-4540-b85c-32bbadc97d52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.158198 Aug 30 01:12:15.889519 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 136/282] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:15 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:16.216198 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ee839a08-b77e-4356-b79f-a23311ae3b69 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:16.216817 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ee839a08-b77e-4356-b79f-a23311ae3b69 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:16.225150 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee839a08-b77e-4356-b79f-a23311ae3b69 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:16.225929 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee839a08-b77e-4356-b79f-a23311ae3b69 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:16.226465 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee839a08-b77e-4356-b79f-a23311ae3b69 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:16.227471 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee839a08-b77e-4356-b79f-a23311ae3b69 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:16.228069 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee839a08-b77e-4356-b79f-a23311ae3b69 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:16.228693 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee839a08-b77e-4356-b79f-a23311ae3b69 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:16.387564 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ee839a08-b77e-4356-b79f-a23311ae3b69 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:16.396218 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ee839a08-b77e-4356-b79f-a23311ae3b69 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1314 microversion: 2.1 time: 0.183845 Aug 30 01:12:16.397092 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 147/283] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:16 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:16.910430 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ab81ddb7-1e3c-4c28-8951-662f0a692fe0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:16.911063 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ab81ddb7-1e3c-4c28-8951-662f0a692fe0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:16.917082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab81ddb7-1e3c-4c28-8951-662f0a692fe0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:16.917557 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab81ddb7-1e3c-4c28-8951-662f0a692fe0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:16.918021 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab81ddb7-1e3c-4c28-8951-662f0a692fe0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:16.918697 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab81ddb7-1e3c-4c28-8951-662f0a692fe0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:16.919176 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab81ddb7-1e3c-4c28-8951-662f0a692fe0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:16.919593 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab81ddb7-1e3c-4c28-8951-662f0a692fe0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:17.062415 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ab81ddb7-1e3c-4c28-8951-662f0a692fe0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:17.070654 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ab81ddb7-1e3c-4c28-8951-662f0a692fe0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.164051 Aug 30 01:12:17.078017 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 137/284] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:16 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:17.421115 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f1479b9c-0a1c-4378-a697-dfee9f0fb697 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:17.424263 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f1479b9c-0a1c-4378-a697-dfee9f0fb697 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:17.430225 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f1479b9c-0a1c-4378-a697-dfee9f0fb697 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:17.430713 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f1479b9c-0a1c-4378-a697-dfee9f0fb697 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:17.431146 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f1479b9c-0a1c-4378-a697-dfee9f0fb697 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:17.431873 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f1479b9c-0a1c-4378-a697-dfee9f0fb697 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:17.432430 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f1479b9c-0a1c-4378-a697-dfee9f0fb697 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:17.432904 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f1479b9c-0a1c-4378-a697-dfee9f0fb697 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:17.568651 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f1479b9c-0a1c-4378-a697-dfee9f0fb697 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:17.577600 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f1479b9c-0a1c-4378-a697-dfee9f0fb697 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1498 microversion: 2.1 time: 0.161227 Aug 30 01:12:17.578432 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 148/285] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:17 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:18.098959 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a5bf4ad5-efb6-47c5-910a-19a1848537ba tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:18.099573 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a5bf4ad5-efb6-47c5-910a-19a1848537ba tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:18.108154 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5bf4ad5-efb6-47c5-910a-19a1848537ba tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:18.108773 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5bf4ad5-efb6-47c5-910a-19a1848537ba tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:18.109316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5bf4ad5-efb6-47c5-910a-19a1848537ba tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:18.110389 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5bf4ad5-efb6-47c5-910a-19a1848537ba tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:18.110948 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5bf4ad5-efb6-47c5-910a-19a1848537ba tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:18.111475 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5bf4ad5-efb6-47c5-910a-19a1848537ba tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:18.270904 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a5bf4ad5-efb6-47c5-910a-19a1848537ba tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:18.280405 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a5bf4ad5-efb6-47c5-910a-19a1848537ba tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.185081 Aug 30 01:12:18.281036 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 138/286] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:18 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:19.301657 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4f38fb06-a640-4882-bd64-f6b68b711e42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:19.302304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4f38fb06-a640-4882-bd64-f6b68b711e42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:19.308791 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f38fb06-a640-4882-bd64-f6b68b711e42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:19.309286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f38fb06-a640-4882-bd64-f6b68b711e42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:19.309821 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f38fb06-a640-4882-bd64-f6b68b711e42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:19.310690 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f38fb06-a640-4882-bd64-f6b68b711e42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:19.311154 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f38fb06-a640-4882-bd64-f6b68b711e42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:19.311584 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f38fb06-a640-4882-bd64-f6b68b711e42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:19.444484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4f38fb06-a640-4882-bd64-f6b68b711e42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:19.453330 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4f38fb06-a640-4882-bd64-f6b68b711e42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.155463 Aug 30 01:12:19.453935 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 149/287] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:19 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:20.480648 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-63d02c01-2912-4826-b5e6-859c8cbdd31f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:20.481183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-63d02c01-2912-4826-b5e6-859c8cbdd31f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:20.487976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d02c01-2912-4826-b5e6-859c8cbdd31f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:20.488467 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d02c01-2912-4826-b5e6-859c8cbdd31f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:20.488906 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d02c01-2912-4826-b5e6-859c8cbdd31f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:20.490159 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d02c01-2912-4826-b5e6-859c8cbdd31f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:20.490159 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d02c01-2912-4826-b5e6-859c8cbdd31f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:20.490492 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d02c01-2912-4826-b5e6-859c8cbdd31f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:20.625649 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-63d02c01-2912-4826-b5e6-859c8cbdd31f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:20.633360 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-63d02c01-2912-4826-b5e6-859c8cbdd31f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.156843 Aug 30 01:12:20.633995 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 139/288] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:20 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:21.543397 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-59956c2a-c7a6-4216-b14e-fc4cb08b2a1a tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] Calling method '.version_select at 0x7fd71d384280>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:21.646673 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-59956c2a-c7a6-4216-b14e-fc4cb08b2a1a tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/62fd6731-9051-4d74-8f70-4826b6ae459a" status: 200 len: 350 microversion: 2.1 time: 0.107270 Aug 30 01:12:21.647493 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 150/289] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 30 01:12:21 2022] GET /compute/v2.1/os-volumes/62fd6731-9051-4d74-8f70-4826b6ae459a => generated 350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:12:21.655542 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5e79d653-7dce-4f7e-a34d-485cc9e92dd3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:21.656746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5e79d653-7dce-4f7e-a34d-485cc9e92dd3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:21.663326 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e79d653-7dce-4f7e-a34d-485cc9e92dd3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:21.663816 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e79d653-7dce-4f7e-a34d-485cc9e92dd3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:21.664259 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e79d653-7dce-4f7e-a34d-485cc9e92dd3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:21.664962 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e79d653-7dce-4f7e-a34d-485cc9e92dd3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:21.665423 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e79d653-7dce-4f7e-a34d-485cc9e92dd3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:21.665893 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e79d653-7dce-4f7e-a34d-485cc9e92dd3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:21.813431 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5e79d653-7dce-4f7e-a34d-485cc9e92dd3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:21.821633 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5e79d653-7dce-4f7e-a34d-485cc9e92dd3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.171034 Aug 30 01:12:21.822239 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 140/290] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:21 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:22.269769 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-bc902c6b-108d-4dc0-9bae-bc72c6fe7503 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:22.270265 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-bc902c6b-108d-4dc0-9bae-bc72c6fe7503 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:22.276560 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc902c6b-108d-4dc0-9bae-bc72c6fe7503 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:22.279855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc902c6b-108d-4dc0-9bae-bc72c6fe7503 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:22.279855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc902c6b-108d-4dc0-9bae-bc72c6fe7503 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:22.279855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc902c6b-108d-4dc0-9bae-bc72c6fe7503 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:22.279855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc902c6b-108d-4dc0-9bae-bc72c6fe7503 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:22.280340 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc902c6b-108d-4dc0-9bae-bc72c6fe7503 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:22.310443 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-bc902c6b-108d-4dc0-9bae-bc72c6fe7503 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Going to try to terminate instance {{(pid=121233) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:12:22.314161 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=100 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:22.661098 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-bc902c6b-108d-4dc0-9bae-bc72c6fe7503 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "DELETE /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 204 len: 0 microversion: 2.1 time: 0.394798 Aug 30 01:12:22.661778 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 151/291] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:12:22 2022] DELETE /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:12:22.671111 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fa7b18d5-29ca-462d-9a92-12dc0af12e09 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:22.671862 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fa7b18d5-29ca-462d-9a92-12dc0af12e09 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:22.678131 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa7b18d5-29ca-462d-9a92-12dc0af12e09 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:22.678615 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa7b18d5-29ca-462d-9a92-12dc0af12e09 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:22.679139 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa7b18d5-29ca-462d-9a92-12dc0af12e09 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:22.679825 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa7b18d5-29ca-462d-9a92-12dc0af12e09 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:22.680275 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa7b18d5-29ca-462d-9a92-12dc0af12e09 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:22.680701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa7b18d5-29ca-462d-9a92-12dc0af12e09 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:22.818858 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fa7b18d5-29ca-462d-9a92-12dc0af12e09 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:22.828577 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fa7b18d5-29ca-462d-9a92-12dc0af12e09 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1504 microversion: 2.1 time: 0.161750 Aug 30 01:12:22.829163 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 141/292] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:22 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:22.847885 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-8e80b38c-e0bc-48bd-817a-f89aec4b362f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:22.848705 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-8e80b38c-e0bc-48bd-817a-f89aec4b362f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:22.854832 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8e80b38c-e0bc-48bd-817a-f89aec4b362f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:22.855322 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8e80b38c-e0bc-48bd-817a-f89aec4b362f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:22.855754 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8e80b38c-e0bc-48bd-817a-f89aec4b362f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:22.856976 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8e80b38c-e0bc-48bd-817a-f89aec4b362f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:22.857588 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8e80b38c-e0bc-48bd-817a-f89aec4b362f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:22.858039 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8e80b38c-e0bc-48bd-817a-f89aec4b362f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:23.009579 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-8e80b38c-e0bc-48bd-817a-f89aec4b362f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:23.017624 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-8e80b38c-e0bc-48bd-817a-f89aec4b362f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.173869 Aug 30 01:12:23.018219 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 152/293] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:22 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:23.374146 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a15a94a0-543a-434b-ad5a-c1ef15fbf515 tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] Calling method '.version_select at 0x7fd71d2a6ee0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:23.424053 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a15a94a0-543a-434b-ad5a-c1ef15fbf515 tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/868f702b-baf7-411d-a822-baddb88f0f40" status: 200 len: 350 microversion: 2.1 time: 0.054669 Aug 30 01:12:23.424627 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 142/294] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 30 01:12:23 2022] GET /compute/v2.1/os-volumes/868f702b-baf7-411d-a822-baddb88f0f40 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:12:23.850214 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-daa33319-e41f-428c-b623-8039b2dde7fc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:23.850828 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-daa33319-e41f-428c-b623-8039b2dde7fc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:23.858531 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-daa33319-e41f-428c-b623-8039b2dde7fc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:23.859022 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-daa33319-e41f-428c-b623-8039b2dde7fc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:23.859458 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-daa33319-e41f-428c-b623-8039b2dde7fc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:23.860156 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-daa33319-e41f-428c-b623-8039b2dde7fc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:23.860615 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-daa33319-e41f-428c-b623-8039b2dde7fc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:23.861040 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-daa33319-e41f-428c-b623-8039b2dde7fc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:24.001327 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-daa33319-e41f-428c-b623-8039b2dde7fc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:24.013909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-daa33319-e41f-428c-b623-8039b2dde7fc tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1504 microversion: 2.1 time: 0.167533 Aug 30 01:12:24.015610 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 153/295] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:23 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:24.040898 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-51077997-9749-477c-ac15-f0e16b5839a8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:24.042048 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-51077997-9749-477c-ac15-f0e16b5839a8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:24.049667 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-51077997-9749-477c-ac15-f0e16b5839a8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:24.050202 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-51077997-9749-477c-ac15-f0e16b5839a8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:24.050713 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-51077997-9749-477c-ac15-f0e16b5839a8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:24.051416 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-51077997-9749-477c-ac15-f0e16b5839a8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:24.051876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-51077997-9749-477c-ac15-f0e16b5839a8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:24.053107 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-51077997-9749-477c-ac15-f0e16b5839a8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:24.223961 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-51077997-9749-477c-ac15-f0e16b5839a8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:24.233976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-51077997-9749-477c-ac15-f0e16b5839a8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.198388 Aug 30 01:12:24.234671 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 143/296] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:24 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:25.048192 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-72a30f46-ea7a-4af2-811d-702142a8c78b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:25.048825 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-72a30f46-ea7a-4af2-811d-702142a8c78b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:25.055767 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-72a30f46-ea7a-4af2-811d-702142a8c78b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:25.056255 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-72a30f46-ea7a-4af2-811d-702142a8c78b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:25.056686 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-72a30f46-ea7a-4af2-811d-702142a8c78b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:25.057600 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-72a30f46-ea7a-4af2-811d-702142a8c78b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:25.058070 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-72a30f46-ea7a-4af2-811d-702142a8c78b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:25.058646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-72a30f46-ea7a-4af2-811d-702142a8c78b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:25.151574 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2fee2cff-e47a-44d8-a881-826bcd015334 tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] Calling method '.version_select at 0x7fd71d429670>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:25.207803 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2fee2cff-e47a-44d8-a881-826bcd015334 tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/dacdd853-e88b-4a58-9f7e-2a7738a5f436" status: 200 len: 350 microversion: 2.1 time: 0.060140 Aug 30 01:12:25.208616 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 144/297] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 30 01:12:25 2022] GET /compute/v2.1/os-volumes/dacdd853-e88b-4a58-9f7e-2a7738a5f436 => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:12:25.217774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-72a30f46-ea7a-4af2-811d-702142a8c78b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:25.222552 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ecdf7536-42a7-46d1-a0c1-38787832c057 tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] Calling method '.version_select at 0x7fd71d15cca0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:25.226878 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-72a30f46-ea7a-4af2-811d-702142a8c78b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1504 microversion: 2.1 time: 0.182976 Aug 30 01:12:25.227551 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 154/298] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:25 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:25.264058 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9f1fcd05-143d-4964-b5ac-98b382b8497e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:25.264058 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9f1fcd05-143d-4964-b5ac-98b382b8497e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:25.285208 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9f1fcd05-143d-4964-b5ac-98b382b8497e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:25.285863 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9f1fcd05-143d-4964-b5ac-98b382b8497e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:25.287647 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9f1fcd05-143d-4964-b5ac-98b382b8497e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:25.288484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9f1fcd05-143d-4964-b5ac-98b382b8497e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:25.289081 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9f1fcd05-143d-4964-b5ac-98b382b8497e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:25.289621 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9f1fcd05-143d-4964-b5ac-98b382b8497e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:25.316679 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ecdf7536-42a7-46d1-a0c1-38787832c057 tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.098268 Aug 30 01:12:25.317909 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 145/299] 10.222.0.52 () {58 vars in 1134 bytes} [Tue Aug 30 01:12:25 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:25.339707 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2e90a452-18f8-4d47-8a7b-b7952a98d7c6 tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] Calling method '.version_select at 0x7fd71d154ee0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:25.457670 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2e90a452-18f8-4d47-8a7b-b7952a98d7c6 tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.122358 Aug 30 01:12:25.458836 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 146/300] 10.222.0.52 () {58 vars in 1149 bytes} [Tue Aug 30 01:12:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:12:25.477002 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5ffdc657-5a50-49e0-aa21-c51370782814 tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] Calling method '.version_select at 0x7fd71d1548b0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:25.506720 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9f1fcd05-143d-4964-b5ac-98b382b8497e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:25.515806 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9f1fcd05-143d-4964-b5ac-98b382b8497e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.262645 Aug 30 01:12:25.517797 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 155/301] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:25 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:25.578581 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-f1d31757-bd0f-4e7f-b3a3-3294c6398fdd req-c1bf4995-ab96-44e3-96a5-a2d3d102e89f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b27c77-eb0e-4f06-93c6-938164beab95", "name": "network-vif-deleted", "tag": "43d9e02b-7717-4924-a8e1-a1ae4be2adc5"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:12:25.591118 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-f1d31757-bd0f-4e7f-b3a3-3294c6398fdd req-c1bf4995-ab96-44e3-96a5-a2d3d102e89f service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:25.592883 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-f1d31757-bd0f-4e7f-b3a3-3294c6398fdd req-c1bf4995-ab96-44e3-96a5-a2d3d102e89f service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:25.593405 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-f1d31757-bd0f-4e7f-b3a3-3294c6398fdd req-c1bf4995-ab96-44e3-96a5-a2d3d102e89f service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:25.600411 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5ffdc657-5a50-49e0-aa21-c51370782814 tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.127067 Aug 30 01:12:25.601947 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 147/302] 10.222.0.52 () {58 vars in 1134 bytes} [Tue Aug 30 01:12:25 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:25.616011 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3060ab39-d22b-4b1d-be7a-abf3fa5eb54e tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] Calling method '.version_select at 0x7fd71d1b1c10>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:25.632428 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-f1d31757-bd0f-4e7f-b3a3-3294c6398fdd req-c1bf4995-ab96-44e3-96a5-a2d3d102e89f service nova] Creating event network-vif-deleted:43d9e02b-7717-4924-a8e1-a1ae4be2adc5 for instance 95b27c77-eb0e-4f06-93c6-938164beab95 on hv-cinder-81571 Aug 30 01:12:25.642425 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-f1d31757-bd0f-4e7f-b3a3-3294c6398fdd req-c1bf4995-ab96-44e3-96a5-a2d3d102e89f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069745 Aug 30 01:12:25.642653 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 156/303] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:12:25.725744 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3060ab39-d22b-4b1d-be7a-abf3fa5eb54e tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.114243 Aug 30 01:12:25.729778 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 148/304] 10.222.0.52 () {58 vars in 1167 bytes} [Tue Aug 30 01:12:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:12:25.740622 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-df1bfaf2-5dea-4ea3-b703-b3a07f6de487 tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] Calling method '.version_select at 0x7fd71d22d9d0>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:25.832178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-df1bfaf2-5dea-4ea3-b703-b3a07f6de487 tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.095658 Aug 30 01:12:25.833530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 157/305] 10.222.0.52 () {58 vars in 1170 bytes} [Tue Aug 30 01:12:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:12:25.846507 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-01908088-cd26-42c6-b2fa-838f0beee362 tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] Calling method '.version_select at 0x7fd71d15cca0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:25.935361 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-01908088-cd26-42c6-b2fa-838f0beee362 tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.092037 Aug 30 01:12:25.936447 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 149/306] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Aug 30 01:12:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:25.948816 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6a527bac-e331-49bc-9971-85e1f05c2234 tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] Calling method '.version_select at 0x7fd71d1cfca0>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:26.036829 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6a527bac-e331-49bc-9971-85e1f05c2234 tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091712 Aug 30 01:12:26.037441 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 158/307] 10.222.0.52 () {58 vars in 1188 bytes} [Tue Aug 30 01:12:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:12:26.051486 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-729d84a9-a672-47c4-8898-5381cb1f683d tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] Calling method '.version_select at 0x7fd71d15c8b0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:26.135007 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-729d84a9-a672-47c4-8898-5381cb1f683d tempest-VolumesTestJSON-816462178 tempest-VolumesTestJSON-816462178-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.087194 Aug 30 01:12:26.136020 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 150/308] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Aug 30 01:12:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:26.251443 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-76b952b3-c877-4cf9-877c-f74ee9f27959 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:26.252732 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-76b952b3-c877-4cf9-877c-f74ee9f27959 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:26.260032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76b952b3-c877-4cf9-877c-f74ee9f27959 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:26.260739 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76b952b3-c877-4cf9-877c-f74ee9f27959 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:26.261614 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76b952b3-c877-4cf9-877c-f74ee9f27959 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:26.264285 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76b952b3-c877-4cf9-877c-f74ee9f27959 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:26.264986 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76b952b3-c877-4cf9-877c-f74ee9f27959 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:26.265552 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76b952b3-c877-4cf9-877c-f74ee9f27959 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:26.304848 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76b952b3-c877-4cf9-877c-f74ee9f27959 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:26.305336 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76b952b3-c877-4cf9-877c-f74ee9f27959 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:26.305790 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76b952b3-c877-4cf9-877c-f74ee9f27959 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:26.306244 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-76b952b3-c877-4cf9-877c-f74ee9f27959 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lazy-loading 'fault' on Instance uuid 95b27c77-eb0e-4f06-93c6-938164beab95 {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:12:26.351088 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-76b952b3-c877-4cf9-877c-f74ee9f27959 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:26.359817 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-76b952b3-c877-4cf9-877c-f74ee9f27959 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 200 len: 1304 microversion: 2.1 time: 0.114450 Aug 30 01:12:26.360229 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 159/309] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:26 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:26.536530 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b196ff58-f4e5-4659-9064-ecaaf18dc2e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:26.537711 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b196ff58-f4e5-4659-9064-ecaaf18dc2e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:26.539276 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:26.544614 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b196ff58-f4e5-4659-9064-ecaaf18dc2e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:26.545106 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b196ff58-f4e5-4659-9064-ecaaf18dc2e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:26.545544 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b196ff58-f4e5-4659-9064-ecaaf18dc2e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:26.546271 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b196ff58-f4e5-4659-9064-ecaaf18dc2e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:26.546729 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b196ff58-f4e5-4659-9064-ecaaf18dc2e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:26.547413 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b196ff58-f4e5-4659-9064-ecaaf18dc2e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:26.677377 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b196ff58-f4e5-4659-9064-ecaaf18dc2e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:26.685969 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b196ff58-f4e5-4659-9064-ecaaf18dc2e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.153387 Aug 30 01:12:26.686570 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 151/310] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:26 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:27.382481 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-1a6cdc29-d672-42bb-ad7f-2c4ecc2bc2a0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:27.383376 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-1a6cdc29-d672-42bb-ad7f-2c4ecc2bc2a0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: 95b27c77-eb0e-4f06-93c6-938164beab95] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:27.390130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1a6cdc29-d672-42bb-ad7f-2c4ecc2bc2a0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:27.390616 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1a6cdc29-d672-42bb-ad7f-2c4ecc2bc2a0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:27.391052 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1a6cdc29-d672-42bb-ad7f-2c4ecc2bc2a0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:27.391747 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1a6cdc29-d672-42bb-ad7f-2c4ecc2bc2a0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:27.392197 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1a6cdc29-d672-42bb-ad7f-2c4ecc2bc2a0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:27.392612 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1a6cdc29-d672-42bb-ad7f-2c4ecc2bc2a0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:27.406678 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-1a6cdc29-d672-42bb-ad7f-2c4ecc2bc2a0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] HTTP exception thrown: Instance 95b27c77-eb0e-4f06-93c6-938164beab95 could not be found. Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-1a6cdc29-d672-42bb-ad7f-2c4ecc2bc2a0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Request method failure captured: Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 HTTP/1.1 Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWPVACdaWjxBawMWHirfR6iEnRQP4VLCRuudRH5fJ6Cli5Wy8jxhdfqq4ejeLSHWudCGXwtMA1Nf3Z2oqHYqhIdtm5c2sgrEwr66lwHBgZSevK-Ao51kRn5wUMdRvFmDK_nFVMpC9cKIJpEwgYt9MfIcG8EHuuDq4mydRF4DtiMNG8s Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 43f140e0f58f42ae96e16f80b480621c Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-VolumesActionsTest-2123755706 Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:12:27.408780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:12:27.411178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/43f140e0f58f42ae96e16f80b480621c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_43f140e0f58f42ae96e16f80b480621c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/43f140e0f58f42ae96e16f80b480621c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/43f140e0f58f42ae96e16f80b480621c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:12:27.411178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-VolumesActionsTest-2123755706 Aug 30 01:12:27.411178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 43f140e0f58f42ae96e16f80b480621c Aug 30 01:12:27.411178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-VolumesActionsTest-2123755706 Aug 30 01:12:27.411178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-VolumesActionsTest-2123755706-project Aug 30 01:12:27.411178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:12:27.411178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:12:27.411178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 1b225b55d18740c2833cade52edc556e Aug 30 01:12:27.411178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-VolumesActionsTest-2123755706-project Aug 30 01:12:27.411178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:12:27.411178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance 95b27c77-eb0e-4f06-93c6-938164beab95 could not be found. Aug 30 01:12:27.411178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': '95b27c77-eb0e-4f06-93c6-938164beab95'} Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b27c77-eb0e-4f06-93c6-938164beab95 could not be found. Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:12:27.412802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b27c77-eb0e-4f06-93c6-938164beab95 could not be found. Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b27c77-eb0e-4f06-93c6-938164beab95 could not be found. Aug 30 01:12:27.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:12:27.417093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-1a6cdc29-d672-42bb-ad7f-2c4ecc2bc2a0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Returning 404 to user: Instance 95b27c77-eb0e-4f06-93c6-938164beab95 could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:12:27.417093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-1a6cdc29-d672-42bb-ad7f-2c4ecc2bc2a0 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95" status: 404 len: 111 microversion: 2.1 time: 0.031330 Aug 30 01:12:27.417093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 160/311] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:27 2022] GET /compute/v2.1/servers/95b27c77-eb0e-4f06-93c6-938164beab95 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:12:27.522409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1761893906", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452", "networks": [{"uuid": "9fb68cff-0330-4b4f-897d-a5b9f49b6d9f"}]}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:12:27.590238 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] validate_networks() for [('9fb68cff-0330-4b4f-897d-a5b9f49b6d9f', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:12:27.707413 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6a6a59f0-4784-468d-acdd-c1993c282be5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:27.707935 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6a6a59f0-4784-468d-acdd-c1993c282be5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:27.714138 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a6a59f0-4784-468d-acdd-c1993c282be5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:27.714621 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a6a59f0-4784-468d-acdd-c1993c282be5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:27.715053 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a6a59f0-4784-468d-acdd-c1993c282be5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:27.716315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a6a59f0-4784-468d-acdd-c1993c282be5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:27.716773 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a6a59f0-4784-468d-acdd-c1993c282be5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:27.717194 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a6a59f0-4784-468d-acdd-c1993c282be5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:27.875481 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6a6a59f0-4784-468d-acdd-c1993c282be5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:27.883932 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6a6a59f0-4784-468d-acdd-c1993c282be5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.180535 Aug 30 01:12:27.884516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 161/312] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:27 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:27.963026 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:12:27.963466 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:12:27.963961 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:12:27.964407 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:12:27.964826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:12:27.976709 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:27.977194 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:27.981833 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:27.981833 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:27.981833 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:27.981833 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:27.996190 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Getting quotas for project 43f140e0f58f42ae96e16f80b480621c. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:12:28.000231 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Getting quotas for user 1b225b55d18740c2833cade52edc556e and project 43f140e0f58f42ae96e16f80b480621c. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:12:28.011990 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:12:28.015141 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:12:28.161488 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3d3b1741-0c65-48c9-9ecb-cdb9453f7576 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642820 Aug 30 01:12:28.162647 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 152/313] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:12:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:12:28.173752 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-1534f1a2-9441-457e-beea-09fce6eec6e4 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:28.174371 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-1534f1a2-9441-457e-beea-09fce6eec6e4 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:28.231822 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-1534f1a2-9441-457e-beea-09fce6eec6e4 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:28.242363 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-1534f1a2-9441-457e-beea-09fce6eec6e4 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1214 microversion: 2.1 time: 0.072965 Aug 30 01:12:28.243248 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 162/314] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:28 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:28.906548 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-328f0fdf-39d2-4112-8c1e-c5e0441aed72 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:28.907211 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-328f0fdf-39d2-4112-8c1e-c5e0441aed72 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:28.914224 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-328f0fdf-39d2-4112-8c1e-c5e0441aed72 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:28.914678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-328f0fdf-39d2-4112-8c1e-c5e0441aed72 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:28.915147 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-328f0fdf-39d2-4112-8c1e-c5e0441aed72 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:28.916214 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-328f0fdf-39d2-4112-8c1e-c5e0441aed72 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:28.916453 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-328f0fdf-39d2-4112-8c1e-c5e0441aed72 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:28.917650 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-328f0fdf-39d2-4112-8c1e-c5e0441aed72 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:29.061194 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-328f0fdf-39d2-4112-8c1e-c5e0441aed72 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:29.069454 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-328f0fdf-39d2-4112-8c1e-c5e0441aed72 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.167065 Aug 30 01:12:29.070205 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 153/315] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:28 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:29.264300 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-28997c60-d0b3-4f33-a805-215a10b88e57 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:29.264920 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-28997c60-d0b3-4f33-a805-215a10b88e57 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:29.272517 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-28997c60-d0b3-4f33-a805-215a10b88e57 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:29.272949 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-28997c60-d0b3-4f33-a805-215a10b88e57 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:29.273427 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-28997c60-d0b3-4f33-a805-215a10b88e57 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:29.274182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-28997c60-d0b3-4f33-a805-215a10b88e57 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:29.274637 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-28997c60-d0b3-4f33-a805-215a10b88e57 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:29.275111 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-28997c60-d0b3-4f33-a805-215a10b88e57 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:29.342289 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-28997c60-d0b3-4f33-a805-215a10b88e57 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:29.347890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-28997c60-d0b3-4f33-a805-215a10b88e57 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1218 microversion: 2.1 time: 0.087545 Aug 30 01:12:29.348441 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 163/316] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:29 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:30.091097 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-16b8a1a1-5eb3-4211-b6ea-20f368fd633f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:30.091709 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-16b8a1a1-5eb3-4211-b6ea-20f368fd633f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:30.097712 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16b8a1a1-5eb3-4211-b6ea-20f368fd633f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:30.103152 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16b8a1a1-5eb3-4211-b6ea-20f368fd633f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:30.103152 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16b8a1a1-5eb3-4211-b6ea-20f368fd633f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:30.103152 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16b8a1a1-5eb3-4211-b6ea-20f368fd633f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:30.103152 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16b8a1a1-5eb3-4211-b6ea-20f368fd633f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:30.103556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16b8a1a1-5eb3-4211-b6ea-20f368fd633f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:30.230300 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-16b8a1a1-5eb3-4211-b6ea-20f368fd633f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:30.239030 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-16b8a1a1-5eb3-4211-b6ea-20f368fd633f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.152117 Aug 30 01:12:30.239611 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 154/317] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:30 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:30.369567 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2fad05e8-e7ce-41e8-a713-5154c3cd267d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:30.370205 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2fad05e8-e7ce-41e8-a713-5154c3cd267d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:30.377585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2fad05e8-e7ce-41e8-a713-5154c3cd267d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:30.378102 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2fad05e8-e7ce-41e8-a713-5154c3cd267d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:30.378535 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2fad05e8-e7ce-41e8-a713-5154c3cd267d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:30.379220 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2fad05e8-e7ce-41e8-a713-5154c3cd267d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:30.379673 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2fad05e8-e7ce-41e8-a713-5154c3cd267d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:30.380098 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2fad05e8-e7ce-41e8-a713-5154c3cd267d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:30.450101 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2fad05e8-e7ce-41e8-a713-5154c3cd267d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:30.457888 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2fad05e8-e7ce-41e8-a713-5154c3cd267d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1210 microversion: 2.1 time: 0.092242 Aug 30 01:12:30.458457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 164/318] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:30 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:31.261213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0cf41353-c5f4-491f-b7ef-edcedf337069 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:31.261868 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0cf41353-c5f4-491f-b7ef-edcedf337069 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:31.268491 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0cf41353-c5f4-491f-b7ef-edcedf337069 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:31.268976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0cf41353-c5f4-491f-b7ef-edcedf337069 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:31.269411 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0cf41353-c5f4-491f-b7ef-edcedf337069 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:31.270124 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0cf41353-c5f4-491f-b7ef-edcedf337069 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:31.270579 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0cf41353-c5f4-491f-b7ef-edcedf337069 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:31.271006 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0cf41353-c5f4-491f-b7ef-edcedf337069 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:31.398304 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0cf41353-c5f4-491f-b7ef-edcedf337069 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:31.406172 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0cf41353-c5f4-491f-b7ef-edcedf337069 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.148718 Aug 30 01:12:31.406747 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 155/319] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:31 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:31.479443 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c00e1c2b-f25e-40c9-88a1-96b02a6c337e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:31.480055 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c00e1c2b-f25e-40c9-88a1-96b02a6c337e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:31.482503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:31.487430 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c00e1c2b-f25e-40c9-88a1-96b02a6c337e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:31.487916 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c00e1c2b-f25e-40c9-88a1-96b02a6c337e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:31.491054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c00e1c2b-f25e-40c9-88a1-96b02a6c337e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:31.491054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c00e1c2b-f25e-40c9-88a1-96b02a6c337e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:31.491054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c00e1c2b-f25e-40c9-88a1-96b02a6c337e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:31.491054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c00e1c2b-f25e-40c9-88a1-96b02a6c337e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:31.552909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c00e1c2b-f25e-40c9-88a1-96b02a6c337e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:31.560745 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c00e1c2b-f25e-40c9-88a1-96b02a6c337e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1210 microversion: 2.1 time: 0.085119 Aug 30 01:12:31.561305 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 165/320] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:31 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:32.428086 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8b35699d-70cc-48ea-bfcf-90eaca1766ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:32.428697 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8b35699d-70cc-48ea-bfcf-90eaca1766ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:32.434664 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b35699d-70cc-48ea-bfcf-90eaca1766ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:32.435140 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b35699d-70cc-48ea-bfcf-90eaca1766ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:32.435573 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b35699d-70cc-48ea-bfcf-90eaca1766ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:32.436253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b35699d-70cc-48ea-bfcf-90eaca1766ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:32.436700 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b35699d-70cc-48ea-bfcf-90eaca1766ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:32.437125 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8b35699d-70cc-48ea-bfcf-90eaca1766ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:32.573872 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8b35699d-70cc-48ea-bfcf-90eaca1766ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:32.587811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c0f908bf-087a-4f54-8f9f-055356467960 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:32.588234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8b35699d-70cc-48ea-bfcf-90eaca1766ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.160124 Aug 30 01:12:32.588322 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c0f908bf-087a-4f54-8f9f-055356467960 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:32.588395 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 156/321] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:32 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:32.591855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c0f908bf-087a-4f54-8f9f-055356467960 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:32.592241 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c0f908bf-087a-4f54-8f9f-055356467960 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:32.592666 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c0f908bf-087a-4f54-8f9f-055356467960 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:32.593352 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c0f908bf-087a-4f54-8f9f-055356467960 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:32.594458 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c0f908bf-087a-4f54-8f9f-055356467960 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:32.594884 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c0f908bf-087a-4f54-8f9f-055356467960 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:32.658689 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c0f908bf-087a-4f54-8f9f-055356467960 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:32.666333 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c0f908bf-087a-4f54-8f9f-055356467960 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1266 microversion: 2.1 time: 0.087299 Aug 30 01:12:32.666890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 166/322] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:32 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:33.606964 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-67bd2ac9-fd4b-4275-a7ec-e0dadf6cf886 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:33.607510 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-67bd2ac9-fd4b-4275-a7ec-e0dadf6cf886 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:33.618964 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-67bd2ac9-fd4b-4275-a7ec-e0dadf6cf886 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:33.620201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-67bd2ac9-fd4b-4275-a7ec-e0dadf6cf886 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:33.620201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-67bd2ac9-fd4b-4275-a7ec-e0dadf6cf886 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:33.620535 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-67bd2ac9-fd4b-4275-a7ec-e0dadf6cf886 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:33.620993 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-67bd2ac9-fd4b-4275-a7ec-e0dadf6cf886 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:33.621597 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-67bd2ac9-fd4b-4275-a7ec-e0dadf6cf886 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:33.690772 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-86570d9e-6f8b-42bb-98f1-c6d91639c79b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:33.691611 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-86570d9e-6f8b-42bb-98f1-c6d91639c79b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:33.699209 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-86570d9e-6f8b-42bb-98f1-c6d91639c79b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:33.700086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-86570d9e-6f8b-42bb-98f1-c6d91639c79b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:33.700685 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-86570d9e-6f8b-42bb-98f1-c6d91639c79b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:33.701789 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-86570d9e-6f8b-42bb-98f1-c6d91639c79b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:33.702158 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-86570d9e-6f8b-42bb-98f1-c6d91639c79b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:33.702599 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-86570d9e-6f8b-42bb-98f1-c6d91639c79b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:33.807324 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-86570d9e-6f8b-42bb-98f1-c6d91639c79b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:33.826929 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-86570d9e-6f8b-42bb-98f1-c6d91639c79b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1266 microversion: 2.1 time: 0.141105 Aug 30 01:12:33.840608 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 167/323] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:33 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:33.858841 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-67bd2ac9-fd4b-4275-a7ec-e0dadf6cf886 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:33.868693 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-67bd2ac9-fd4b-4275-a7ec-e0dadf6cf886 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.265830 Aug 30 01:12:33.869257 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 157/324] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:33 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:34.848822 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9b87df88-aa32-430e-8352-40dba8c51b78 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:34.850478 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9b87df88-aa32-430e-8352-40dba8c51b78 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:34.857768 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9b87df88-aa32-430e-8352-40dba8c51b78 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:34.858241 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9b87df88-aa32-430e-8352-40dba8c51b78 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:34.858674 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9b87df88-aa32-430e-8352-40dba8c51b78 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:34.859890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9b87df88-aa32-430e-8352-40dba8c51b78 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:34.860343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9b87df88-aa32-430e-8352-40dba8c51b78 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:34.860766 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9b87df88-aa32-430e-8352-40dba8c51b78 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:34.893692 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d0416b4a-58a1-41c0-b68d-dc0524af8f20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:34.894572 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d0416b4a-58a1-41c0-b68d-dc0524af8f20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:34.902993 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0416b4a-58a1-41c0-b68d-dc0524af8f20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:34.903524 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0416b4a-58a1-41c0-b68d-dc0524af8f20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:34.904392 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0416b4a-58a1-41c0-b68d-dc0524af8f20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:34.905199 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0416b4a-58a1-41c0-b68d-dc0524af8f20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:34.906627 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0416b4a-58a1-41c0-b68d-dc0524af8f20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:34.907094 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0416b4a-58a1-41c0-b68d-dc0524af8f20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:34.927963 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9b87df88-aa32-430e-8352-40dba8c51b78 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:34.935881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9b87df88-aa32-430e-8352-40dba8c51b78 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1266 microversion: 2.1 time: 0.091260 Aug 30 01:12:34.950235 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 168/325] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:34 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:35.044139 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d0416b4a-58a1-41c0-b68d-dc0524af8f20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:35.052390 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d0416b4a-58a1-41c0-b68d-dc0524af8f20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.162826 Aug 30 01:12:35.052963 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 158/326] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:34 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:35.969100 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-35a2a0e8-bc77-4c4d-964a-66e74306a59c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:35.970517 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-35a2a0e8-bc77-4c4d-964a-66e74306a59c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:35.977066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-35a2a0e8-bc77-4c4d-964a-66e74306a59c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:35.977821 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-35a2a0e8-bc77-4c4d-964a-66e74306a59c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:35.978416 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-35a2a0e8-bc77-4c4d-964a-66e74306a59c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:35.979131 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-35a2a0e8-bc77-4c4d-964a-66e74306a59c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:35.979588 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-35a2a0e8-bc77-4c4d-964a-66e74306a59c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:35.980239 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-35a2a0e8-bc77-4c4d-964a-66e74306a59c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:36.075414 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-35a2a0e8-bc77-4c4d-964a-66e74306a59c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:36.075607 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-15fb491c-fe6f-4edd-a9f9-6b04b40e3951 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:36.076453 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-15fb491c-fe6f-4edd-a9f9-6b04b40e3951 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:36.091941 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-35a2a0e8-bc77-4c4d-964a-66e74306a59c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1274 microversion: 2.1 time: 0.126565 Aug 30 01:12:36.095566 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15fb491c-fe6f-4edd-a9f9-6b04b40e3951 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:36.096318 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15fb491c-fe6f-4edd-a9f9-6b04b40e3951 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:36.096753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15fb491c-fe6f-4edd-a9f9-6b04b40e3951 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:36.097509 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15fb491c-fe6f-4edd-a9f9-6b04b40e3951 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:36.098353 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15fb491c-fe6f-4edd-a9f9-6b04b40e3951 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:36.099186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15fb491c-fe6f-4edd-a9f9-6b04b40e3951 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:36.109507 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 169/327] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:35 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1274 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:36.355395 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-15fb491c-fe6f-4edd-a9f9-6b04b40e3951 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:36.365609 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-15fb491c-fe6f-4edd-a9f9-6b04b40e3951 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1522 microversion: 2.1 time: 0.293657 Aug 30 01:12:36.365609 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 159/328] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:36 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:37.116829 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-32419089-7579-440a-b804-d74606228392 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:37.117429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-32419089-7579-440a-b804-d74606228392 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:37.123802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-32419089-7579-440a-b804-d74606228392 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:37.124281 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-32419089-7579-440a-b804-d74606228392 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:37.125349 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-32419089-7579-440a-b804-d74606228392 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:37.126200 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-32419089-7579-440a-b804-d74606228392 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:37.131938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-32419089-7579-440a-b804-d74606228392 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:37.131938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-32419089-7579-440a-b804-d74606228392 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:37.274567 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-32419089-7579-440a-b804-d74606228392 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:37.276955 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:37.281847 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-32419089-7579-440a-b804-d74606228392 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1314 microversion: 2.1 time: 0.168638 Aug 30 01:12:37.282615 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 170/329] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:37 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:37.385392 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b9fa74dd-7e6f-4532-be30-8cea444f9e56 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:37.386038 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b9fa74dd-7e6f-4532-be30-8cea444f9e56 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:37.392970 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9fa74dd-7e6f-4532-be30-8cea444f9e56 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:37.393584 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9fa74dd-7e6f-4532-be30-8cea444f9e56 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:37.394020 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9fa74dd-7e6f-4532-be30-8cea444f9e56 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:37.394720 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9fa74dd-7e6f-4532-be30-8cea444f9e56 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:37.395176 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9fa74dd-7e6f-4532-be30-8cea444f9e56 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:37.395764 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9fa74dd-7e6f-4532-be30-8cea444f9e56 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:37.669621 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b9fa74dd-7e6f-4532-be30-8cea444f9e56 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:37.680885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b9fa74dd-7e6f-4532-be30-8cea444f9e56 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1502 microversion: 2.1 time: 0.299222 Aug 30 01:12:37.682139 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 160/330] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:37 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1502 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:37.708911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4bcee309-a03f-4d8d-bf90-55cb4951bba4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:37.709915 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4bcee309-a03f-4d8d-bf90-55cb4951bba4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:37.716694 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4bcee309-a03f-4d8d-bf90-55cb4951bba4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:37.717174 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4bcee309-a03f-4d8d-bf90-55cb4951bba4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:37.717602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4bcee309-a03f-4d8d-bf90-55cb4951bba4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:37.718352 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4bcee309-a03f-4d8d-bf90-55cb4951bba4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:37.719386 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4bcee309-a03f-4d8d-bf90-55cb4951bba4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:37.719982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4bcee309-a03f-4d8d-bf90-55cb4951bba4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:37.853083 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4bcee309-a03f-4d8d-bf90-55cb4951bba4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:37.861767 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4bcee309-a03f-4d8d-bf90-55cb4951bba4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1516 microversion: 2.1 time: 0.157796 Aug 30 01:12:37.865590 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 171/331] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:37 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:38.304995 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-a83475bc-5c47-4ceb-aa27-fcb52510be57 req-74a0b6a6-e868-4ebc-b699-3024a35a04a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0604dba-37d3-4990-8ee6-38201f0fab53", "tag": "2d5afc80-dacf-45bd-81f8-28c6788c55a4"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:12:38.305237 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ec3a188b-c7fe-4aa1-82e9-c6cf38183c66 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:38.305884 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ec3a188b-c7fe-4aa1-82e9-c6cf38183c66 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:38.309618 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=2 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:38.312041 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:38.313435 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=6 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:38.319861 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-a83475bc-5c47-4ceb-aa27-fcb52510be57 req-74a0b6a6-e868-4ebc-b699-3024a35a04a0 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:38.320888 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-a83475bc-5c47-4ceb-aa27-fcb52510be57 req-74a0b6a6-e868-4ebc-b699-3024a35a04a0 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:38.321580 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-a83475bc-5c47-4ceb-aa27-fcb52510be57 req-74a0b6a6-e868-4ebc-b699-3024a35a04a0 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:38.321712 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec3a188b-c7fe-4aa1-82e9-c6cf38183c66 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:38.322159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec3a188b-c7fe-4aa1-82e9-c6cf38183c66 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:38.322605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec3a188b-c7fe-4aa1-82e9-c6cf38183c66 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:38.323349 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec3a188b-c7fe-4aa1-82e9-c6cf38183c66 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:38.323901 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec3a188b-c7fe-4aa1-82e9-c6cf38183c66 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:38.324271 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec3a188b-c7fe-4aa1-82e9-c6cf38183c66 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:38.337327 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-a83475bc-5c47-4ceb-aa27-fcb52510be57 req-74a0b6a6-e868-4ebc-b699-3024a35a04a0 service nova] Creating event network-changed:2d5afc80-dacf-45bd-81f8-28c6788c55a4 for instance e0604dba-37d3-4990-8ee6-38201f0fab53 on hv-cinder-81571 Aug 30 01:12:38.345128 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-a83475bc-5c47-4ceb-aa27-fcb52510be57 req-74a0b6a6-e868-4ebc-b699-3024a35a04a0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052758 Aug 30 01:12:38.346352 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 161/332] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:12:38.489054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ec3a188b-c7fe-4aa1-82e9-c6cf38183c66 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:38.496978 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ec3a188b-c7fe-4aa1-82e9-c6cf38183c66 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1314 microversion: 2.1 time: 0.196678 Aug 30 01:12:38.497565 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 172/333] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:38 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:39.522181 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-70f61d25-12a3-4d23-a5dd-72e86c5c9d9c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:39.522181 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-70f61d25-12a3-4d23-a5dd-72e86c5c9d9c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:39.527808 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70f61d25-12a3-4d23-a5dd-72e86c5c9d9c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:39.528296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70f61d25-12a3-4d23-a5dd-72e86c5c9d9c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:39.528731 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70f61d25-12a3-4d23-a5dd-72e86c5c9d9c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:39.529421 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70f61d25-12a3-4d23-a5dd-72e86c5c9d9c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:39.529905 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70f61d25-12a3-4d23-a5dd-72e86c5c9d9c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:39.530325 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70f61d25-12a3-4d23-a5dd-72e86c5c9d9c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:39.696874 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-70f61d25-12a3-4d23-a5dd-72e86c5c9d9c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:39.700595 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:39.707079 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-70f61d25-12a3-4d23-a5dd-72e86c5c9d9c tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1314 microversion: 2.1 time: 0.192608 Aug 30 01:12:39.707677 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 162/334] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:39 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:40.208841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-aa33b8b7-d916-4b83-8dfb-fc436ece3a91 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:12:40.211785 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-aa33b8b7-d916-4b83-8dfb-fc436ece3a91 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:40.219753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aa33b8b7-d916-4b83-8dfb-fc436ece3a91 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:40.220244 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aa33b8b7-d916-4b83-8dfb-fc436ece3a91 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:40.221931 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aa33b8b7-d916-4b83-8dfb-fc436ece3a91 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:40.222698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aa33b8b7-d916-4b83-8dfb-fc436ece3a91 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:40.223162 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aa33b8b7-d916-4b83-8dfb-fc436ece3a91 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:40.223590 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-aa33b8b7-d916-4b83-8dfb-fc436ece3a91 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:40.248514 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-aa33b8b7-d916-4b83-8dfb-fc436ece3a91 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lazy-loading 'flavor' on Instance uuid e1388d14-c15e-4f95-9b68-944001f0d53a {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:12:40.728480 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f8bd36b6-e8d8-4979-a0b3-85441cb26ff3 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:40.729117 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f8bd36b6-e8d8-4979-a0b3-85441cb26ff3 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:40.735714 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8bd36b6-e8d8-4979-a0b3-85441cb26ff3 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:40.736199 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8bd36b6-e8d8-4979-a0b3-85441cb26ff3 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:40.736635 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8bd36b6-e8d8-4979-a0b3-85441cb26ff3 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:40.737328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8bd36b6-e8d8-4979-a0b3-85441cb26ff3 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:40.737819 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8bd36b6-e8d8-4979-a0b3-85441cb26ff3 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:40.738250 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8bd36b6-e8d8-4979-a0b3-85441cb26ff3 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:40.756176 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-aa33b8b7-d916-4b83-8dfb-fc436ece3a91 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "POST /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a/action" status: 200 len: 32 microversion: 2.1 time: 0.550984 Aug 30 01:12:40.756799 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 173/335] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 30 01:12:40 2022] POST /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a/action => generated 32 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 01:12:40.768150 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-19d08a76-d931-43d4-ab50-de0bc4fa2f8e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:40.768855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-19d08a76-d931-43d4-ab50-de0bc4fa2f8e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:40.775231 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-19d08a76-d931-43d4-ab50-de0bc4fa2f8e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:40.775697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-19d08a76-d931-43d4-ab50-de0bc4fa2f8e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:40.776129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-19d08a76-d931-43d4-ab50-de0bc4fa2f8e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:40.776844 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-19d08a76-d931-43d4-ab50-de0bc4fa2f8e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:40.777398 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-19d08a76-d931-43d4-ab50-de0bc4fa2f8e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:40.777756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-19d08a76-d931-43d4-ab50-de0bc4fa2f8e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:40.905563 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f8bd36b6-e8d8-4979-a0b3-85441cb26ff3 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:40.914420 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f8bd36b6-e8d8-4979-a0b3-85441cb26ff3 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1314 microversion: 2.1 time: 0.189729 Aug 30 01:12:40.929712 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 163/336] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:40 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:40.934975 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-19d08a76-d931-43d4-ab50-de0bc4fa2f8e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:40.945232 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-19d08a76-d931-43d4-ab50-de0bc4fa2f8e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.181612 Aug 30 01:12:40.945852 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 174/337] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:40 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:41.950762 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-69f9a229-7dc1-40b1-87b6-bc5590591403 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:41.951409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-69f9a229-7dc1-40b1-87b6-bc5590591403 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:41.958530 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69f9a229-7dc1-40b1-87b6-bc5590591403 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:41.959019 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69f9a229-7dc1-40b1-87b6-bc5590591403 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:41.959456 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69f9a229-7dc1-40b1-87b6-bc5590591403 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:41.960150 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69f9a229-7dc1-40b1-87b6-bc5590591403 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:41.960603 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69f9a229-7dc1-40b1-87b6-bc5590591403 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:41.961019 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69f9a229-7dc1-40b1-87b6-bc5590591403 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:41.967358 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-434b1c42-6765-4d63-a874-f904ae875bd9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:41.967907 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-434b1c42-6765-4d63-a874-f904ae875bd9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:41.975754 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-434b1c42-6765-4d63-a874-f904ae875bd9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:41.976245 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-434b1c42-6765-4d63-a874-f904ae875bd9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:41.976815 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-434b1c42-6765-4d63-a874-f904ae875bd9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:41.977522 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-434b1c42-6765-4d63-a874-f904ae875bd9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:41.978257 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-434b1c42-6765-4d63-a874-f904ae875bd9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:41.978421 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-434b1c42-6765-4d63-a874-f904ae875bd9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:42.143140 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-434b1c42-6765-4d63-a874-f904ae875bd9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:42.150911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-434b1c42-6765-4d63-a874-f904ae875bd9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.187274 Aug 30 01:12:42.151568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 175/338] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:41 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:42.151683 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-69f9a229-7dc1-40b1-87b6-bc5590591403 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:42.164007 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-69f9a229-7dc1-40b1-87b6-bc5590591403 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1314 microversion: 2.1 time: 0.217976 Aug 30 01:12:42.169828 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 164/339] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:41 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:43.174125 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-8a8c9249-2260-48a9-a670-a3fc0bebc7bb tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:43.174711 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-8a8c9249-2260-48a9-a670-a3fc0bebc7bb tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:43.181403 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8a8c9249-2260-48a9-a670-a3fc0bebc7bb tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:43.181940 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8a8c9249-2260-48a9-a670-a3fc0bebc7bb tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:43.182393 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8a8c9249-2260-48a9-a670-a3fc0bebc7bb tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:43.183080 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8a8c9249-2260-48a9-a670-a3fc0bebc7bb tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:43.183616 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8a8c9249-2260-48a9-a670-a3fc0bebc7bb tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:43.183960 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8a8c9249-2260-48a9-a670-a3fc0bebc7bb tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:43.184875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a2735dea-38d3-4773-9460-ed684e648f4b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:43.185562 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a2735dea-38d3-4773-9460-ed684e648f4b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:43.192459 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2735dea-38d3-4773-9460-ed684e648f4b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:43.193030 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2735dea-38d3-4773-9460-ed684e648f4b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:43.193471 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2735dea-38d3-4773-9460-ed684e648f4b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:43.194202 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2735dea-38d3-4773-9460-ed684e648f4b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:43.194661 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2735dea-38d3-4773-9460-ed684e648f4b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:43.195087 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2735dea-38d3-4773-9460-ed684e648f4b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:43.327038 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-8a8c9249-2260-48a9-a670-a3fc0bebc7bb tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:43.336832 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-8a8c9249-2260-48a9-a670-a3fc0bebc7bb tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.167186 Aug 30 01:12:43.338401 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 176/340] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:43 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:43.357889 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a2735dea-38d3-4773-9460-ed684e648f4b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:43.365908 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a2735dea-38d3-4773-9460-ed684e648f4b tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1314 microversion: 2.1 time: 0.185229 Aug 30 01:12:43.366482 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 165/341] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:43 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:44.358469 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-54834f62-b756-45ae-a161-7ee0b1172a8d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:44.359820 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-54834f62-b756-45ae-a161-7ee0b1172a8d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:44.366770 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54834f62-b756-45ae-a161-7ee0b1172a8d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:44.367258 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54834f62-b756-45ae-a161-7ee0b1172a8d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:44.367697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54834f62-b756-45ae-a161-7ee0b1172a8d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:44.368404 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54834f62-b756-45ae-a161-7ee0b1172a8d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:44.368855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54834f62-b756-45ae-a161-7ee0b1172a8d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:44.369298 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54834f62-b756-45ae-a161-7ee0b1172a8d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:44.387504 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-95064427-e921-485e-a9cc-6168b62c0052 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:44.397553 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-95064427-e921-485e-a9cc-6168b62c0052 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:44.405468 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95064427-e921-485e-a9cc-6168b62c0052 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:44.406946 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95064427-e921-485e-a9cc-6168b62c0052 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:44.406946 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95064427-e921-485e-a9cc-6168b62c0052 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:44.407236 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95064427-e921-485e-a9cc-6168b62c0052 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:44.407812 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95064427-e921-485e-a9cc-6168b62c0052 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:44.408175 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-95064427-e921-485e-a9cc-6168b62c0052 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:44.537390 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-54834f62-b756-45ae-a161-7ee0b1172a8d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:44.544850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-54834f62-b756-45ae-a161-7ee0b1172a8d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.190189 Aug 30 01:12:44.545426 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 177/342] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:44 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:44.571340 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-95064427-e921-485e-a9cc-6168b62c0052 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:44.579903 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-95064427-e921-485e-a9cc-6168b62c0052 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1314 microversion: 2.1 time: 0.196326 Aug 30 01:12:44.580482 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 166/343] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:44 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:45.567172 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-76a50036-455b-4834-be98-5a87148fd71a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:45.567771 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-76a50036-455b-4834-be98-5a87148fd71a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:45.574289 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76a50036-455b-4834-be98-5a87148fd71a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:45.574761 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76a50036-455b-4834-be98-5a87148fd71a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:45.575191 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76a50036-455b-4834-be98-5a87148fd71a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:45.575873 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76a50036-455b-4834-be98-5a87148fd71a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:45.576324 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76a50036-455b-4834-be98-5a87148fd71a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:45.576746 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76a50036-455b-4834-be98-5a87148fd71a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:45.600890 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e8d917b8-7450-4cc3-a2b8-e893e3605501 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:45.601512 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e8d917b8-7450-4cc3-a2b8-e893e3605501 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:45.607692 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8d917b8-7450-4cc3-a2b8-e893e3605501 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:45.608175 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8d917b8-7450-4cc3-a2b8-e893e3605501 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:45.608648 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8d917b8-7450-4cc3-a2b8-e893e3605501 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:45.610072 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8d917b8-7450-4cc3-a2b8-e893e3605501 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:45.610702 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8d917b8-7450-4cc3-a2b8-e893e3605501 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:45.611292 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8d917b8-7450-4cc3-a2b8-e893e3605501 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:45.722754 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-76a50036-455b-4834-be98-5a87148fd71a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:45.729941 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-76a50036-455b-4834-be98-5a87148fd71a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.166614 Aug 30 01:12:45.730607 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 178/344] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:45 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:45.771966 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e8d917b8-7450-4cc3-a2b8-e893e3605501 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:45.779677 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e8d917b8-7450-4cc3-a2b8-e893e3605501 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1314 microversion: 2.1 time: 0.182649 Aug 30 01:12:45.780244 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 167/345] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:45 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:46.755652 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b3594213-342c-46db-bd92-a32d92354019 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:46.756261 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b3594213-342c-46db-bd92-a32d92354019 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:46.763152 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b3594213-342c-46db-bd92-a32d92354019 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:46.763641 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b3594213-342c-46db-bd92-a32d92354019 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:46.764070 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b3594213-342c-46db-bd92-a32d92354019 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:46.764767 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b3594213-342c-46db-bd92-a32d92354019 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:46.765322 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b3594213-342c-46db-bd92-a32d92354019 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:46.766134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b3594213-342c-46db-bd92-a32d92354019 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:46.801697 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9b6894a6-6c5e-489e-b62a-e7fb51254792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:46.802420 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9b6894a6-6c5e-489e-b62a-e7fb51254792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:46.809162 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9b6894a6-6c5e-489e-b62a-e7fb51254792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:46.809754 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9b6894a6-6c5e-489e-b62a-e7fb51254792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:46.810432 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9b6894a6-6c5e-489e-b62a-e7fb51254792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:46.811203 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9b6894a6-6c5e-489e-b62a-e7fb51254792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:46.811720 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9b6894a6-6c5e-489e-b62a-e7fb51254792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:46.813061 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9b6894a6-6c5e-489e-b62a-e7fb51254792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:46.899168 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-b3594213-342c-46db-bd92-a32d92354019 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:46.908160 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-b3594213-342c-46db-bd92-a32d92354019 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.156373 Aug 30 01:12:46.908739 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 179/346] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:46 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:46.947059 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9b6894a6-6c5e-489e-b62a-e7fb51254792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:46.955711 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9b6894a6-6c5e-489e-b62a-e7fb51254792 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1314 microversion: 2.1 time: 0.158089 Aug 30 01:12:46.956284 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 168/347] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:46 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:47.929857 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9ce79cc3-348a-4ded-b16e-d3cdaf5e1a42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:47.930383 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9ce79cc3-348a-4ded-b16e-d3cdaf5e1a42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:47.936686 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9ce79cc3-348a-4ded-b16e-d3cdaf5e1a42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:47.937718 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9ce79cc3-348a-4ded-b16e-d3cdaf5e1a42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:47.938174 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9ce79cc3-348a-4ded-b16e-d3cdaf5e1a42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:47.938852 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9ce79cc3-348a-4ded-b16e-d3cdaf5e1a42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:47.939295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9ce79cc3-348a-4ded-b16e-d3cdaf5e1a42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:47.942785 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9ce79cc3-348a-4ded-b16e-d3cdaf5e1a42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:47.976404 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-82f28302-5549-49b5-962c-353036c5363a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:47.977008 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-82f28302-5549-49b5-962c-353036c5363a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:47.983139 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82f28302-5549-49b5-962c-353036c5363a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:47.983623 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82f28302-5549-49b5-962c-353036c5363a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:47.984132 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82f28302-5549-49b5-962c-353036c5363a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:47.985133 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82f28302-5549-49b5-962c-353036c5363a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:47.985596 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82f28302-5549-49b5-962c-353036c5363a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:47.986050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82f28302-5549-49b5-962c-353036c5363a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:48.072155 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9ce79cc3-348a-4ded-b16e-d3cdaf5e1a42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:48.080081 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9ce79cc3-348a-4ded-b16e-d3cdaf5e1a42 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.154229 Aug 30 01:12:48.080657 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 180/348] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:47 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:48.118485 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-82f28302-5549-49b5-962c-353036c5363a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:48.126714 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-82f28302-5549-49b5-962c-353036c5363a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1314 microversion: 2.1 time: 0.154056 Aug 30 01:12:48.127279 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 169/349] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:47 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:49.100573 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6ed23f3a-f583-49d2-9d26-81485c53e96d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:49.101181 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6ed23f3a-f583-49d2-9d26-81485c53e96d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:49.107752 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6ed23f3a-f583-49d2-9d26-81485c53e96d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:49.108237 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6ed23f3a-f583-49d2-9d26-81485c53e96d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:49.108720 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6ed23f3a-f583-49d2-9d26-81485c53e96d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:49.109401 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6ed23f3a-f583-49d2-9d26-81485c53e96d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:49.109882 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6ed23f3a-f583-49d2-9d26-81485c53e96d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:49.110308 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6ed23f3a-f583-49d2-9d26-81485c53e96d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:49.147802 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ce78c9c2-d7e7-42c6-8706-beb7bb7a9949 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:49.148764 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ce78c9c2-d7e7-42c6-8706-beb7bb7a9949 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:49.155166 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce78c9c2-d7e7-42c6-8706-beb7bb7a9949 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:49.156440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce78c9c2-d7e7-42c6-8706-beb7bb7a9949 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:49.156994 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce78c9c2-d7e7-42c6-8706-beb7bb7a9949 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:49.157915 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce78c9c2-d7e7-42c6-8706-beb7bb7a9949 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:49.158612 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce78c9c2-d7e7-42c6-8706-beb7bb7a9949 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:49.159132 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce78c9c2-d7e7-42c6-8706-beb7bb7a9949 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:49.252484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6ed23f3a-f583-49d2-9d26-81485c53e96d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:49.260475 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6ed23f3a-f583-49d2-9d26-81485c53e96d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.163723 Aug 30 01:12:49.261082 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 181/350] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:49 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:49.320489 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ce78c9c2-d7e7-42c6-8706-beb7bb7a9949 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:49.329893 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ce78c9c2-d7e7-42c6-8706-beb7bb7a9949 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1314 microversion: 2.1 time: 0.186114 Aug 30 01:12:49.330486 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 170/351] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:49 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:50.283520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-63dfb765-398f-418e-b9a9-661d4cada6b0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:50.284162 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-63dfb765-398f-418e-b9a9-661d4cada6b0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:50.290290 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63dfb765-398f-418e-b9a9-661d4cada6b0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:50.291069 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63dfb765-398f-418e-b9a9-661d4cada6b0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:50.291516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63dfb765-398f-418e-b9a9-661d4cada6b0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:50.292211 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63dfb765-398f-418e-b9a9-661d4cada6b0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:50.292705 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63dfb765-398f-418e-b9a9-661d4cada6b0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:50.293165 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63dfb765-398f-418e-b9a9-661d4cada6b0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:50.354191 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9628b019-de59-49fa-adec-04bc4cd491d8 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:50.354884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9628b019-de59-49fa-adec-04bc4cd491d8 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:50.362397 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9628b019-de59-49fa-adec-04bc4cd491d8 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:50.362885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9628b019-de59-49fa-adec-04bc4cd491d8 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:50.363489 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9628b019-de59-49fa-adec-04bc4cd491d8 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:50.364349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9628b019-de59-49fa-adec-04bc4cd491d8 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:50.364966 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9628b019-de59-49fa-adec-04bc4cd491d8 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:50.365395 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9628b019-de59-49fa-adec-04bc4cd491d8 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:50.439509 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-63dfb765-398f-418e-b9a9-661d4cada6b0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:50.447961 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-63dfb765-398f-418e-b9a9-661d4cada6b0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.170456 Aug 30 01:12:50.448803 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 182/352] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:50 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:50.512117 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9628b019-de59-49fa-adec-04bc4cd491d8 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:50.521319 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9628b019-de59-49fa-adec-04bc4cd491d8 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1314 microversion: 2.1 time: 0.171386 Aug 30 01:12:50.521937 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 171/353] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:50 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:50.769115 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-a2411821-d9db-4695-b24f-8091c1720b5d req-a86d25da-c2f7-4056-8f66-a18f51f6e910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0604dba-37d3-4990-8ee6-38201f0fab53", "name": "network-vif-plugged", "status": "completed", "tag": "2d5afc80-dacf-45bd-81f8-28c6788c55a4"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:12:50.778620 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-a2411821-d9db-4695-b24f-8091c1720b5d req-a86d25da-c2f7-4056-8f66-a18f51f6e910 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:50.779102 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-a2411821-d9db-4695-b24f-8091c1720b5d req-a86d25da-c2f7-4056-8f66-a18f51f6e910 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:50.779540 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-a2411821-d9db-4695-b24f-8091c1720b5d req-a86d25da-c2f7-4056-8f66-a18f51f6e910 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:50.791533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-a2411821-d9db-4695-b24f-8091c1720b5d req-a86d25da-c2f7-4056-8f66-a18f51f6e910 service nova] Creating event network-vif-plugged:2d5afc80-dacf-45bd-81f8-28c6788c55a4 for instance e0604dba-37d3-4990-8ee6-38201f0fab53 on hv-cinder-81571 Aug 30 01:12:50.797969 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-a2411821-d9db-4695-b24f-8091c1720b5d req-a86d25da-c2f7-4056-8f66-a18f51f6e910 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034030 Aug 30 01:12:50.798599 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 183/354] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:12:51.081716 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b169413d-ddf3-45a6-8977-29fb33306e28 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:51.082231 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b169413d-ddf3-45a6-8977-29fb33306e28 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:51.088290 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b169413d-ddf3-45a6-8977-29fb33306e28 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:51.088776 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b169413d-ddf3-45a6-8977-29fb33306e28 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:51.089260 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b169413d-ddf3-45a6-8977-29fb33306e28 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:51.089939 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b169413d-ddf3-45a6-8977-29fb33306e28 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:51.090398 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b169413d-ddf3-45a6-8977-29fb33306e28 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:51.090822 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b169413d-ddf3-45a6-8977-29fb33306e28 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:51.115500 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b169413d-ddf3-45a6-8977-29fb33306e28 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/ips" status: 200 len: 144 microversion: 2.1 time: 0.038044 Aug 30 01:12:51.116111 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 172/355] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 30 01:12:51 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:12:51.470645 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c9c8193b-e591-4efc-8cba-72326c33a74e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:51.471346 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c9c8193b-e591-4efc-8cba-72326c33a74e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:51.477847 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c9c8193b-e591-4efc-8cba-72326c33a74e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:51.478333 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c9c8193b-e591-4efc-8cba-72326c33a74e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:51.478773 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c9c8193b-e591-4efc-8cba-72326c33a74e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:51.479465 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c9c8193b-e591-4efc-8cba-72326c33a74e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:51.479920 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c9c8193b-e591-4efc-8cba-72326c33a74e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:51.480348 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c9c8193b-e591-4efc-8cba-72326c33a74e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:51.542702 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-905395b6-cc7f-4ec3-a13e-00df35216794 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:51.544108 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-905395b6-cc7f-4ec3-a13e-00df35216794 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:51.550971 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-905395b6-cc7f-4ec3-a13e-00df35216794 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:51.551476 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-905395b6-cc7f-4ec3-a13e-00df35216794 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:51.551963 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-905395b6-cc7f-4ec3-a13e-00df35216794 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:51.552678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-905395b6-cc7f-4ec3-a13e-00df35216794 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:51.553140 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-905395b6-cc7f-4ec3-a13e-00df35216794 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:51.553771 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-905395b6-cc7f-4ec3-a13e-00df35216794 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:51.635218 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c9c8193b-e591-4efc-8cba-72326c33a74e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:51.641456 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c9c8193b-e591-4efc-8cba-72326c33a74e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.173767 Aug 30 01:12:51.642694 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 184/356] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:51 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:51.698866 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-905395b6-cc7f-4ec3-a13e-00df35216794 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:51.708142 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-905395b6-cc7f-4ec3-a13e-00df35216794 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1314 microversion: 2.1 time: 0.169166 Aug 30 01:12:51.708757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 173/357] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:51 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:52.664542 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-84724ac8-d283-44f9-a6d1-a9fbaab9c476 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:52.665710 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-84724ac8-d283-44f9-a6d1-a9fbaab9c476 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:52.679640 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-84724ac8-d283-44f9-a6d1-a9fbaab9c476 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:52.680855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-84724ac8-d283-44f9-a6d1-a9fbaab9c476 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:52.680855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-84724ac8-d283-44f9-a6d1-a9fbaab9c476 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:52.681257 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-84724ac8-d283-44f9-a6d1-a9fbaab9c476 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:52.681721 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-84724ac8-d283-44f9-a6d1-a9fbaab9c476 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:52.682180 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-84724ac8-d283-44f9-a6d1-a9fbaab9c476 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:52.731669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-96b6feec-856e-451f-aac9-db37245e1ada tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:52.732286 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-96b6feec-856e-451f-aac9-db37245e1ada tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:52.739692 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96b6feec-856e-451f-aac9-db37245e1ada tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:52.740162 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96b6feec-856e-451f-aac9-db37245e1ada tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:52.740768 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96b6feec-856e-451f-aac9-db37245e1ada tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:52.741662 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96b6feec-856e-451f-aac9-db37245e1ada tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:52.742323 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96b6feec-856e-451f-aac9-db37245e1ada tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:52.742906 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96b6feec-856e-451f-aac9-db37245e1ada tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:52.848000 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-84724ac8-d283-44f9-a6d1-a9fbaab9c476 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:52.856652 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-84724ac8-d283-44f9-a6d1-a9fbaab9c476 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.196114 Aug 30 01:12:52.857242 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 185/358] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:52 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:52.884795 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-96b6feec-856e-451f-aac9-db37245e1ada tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:52.893854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-96b6feec-856e-451f-aac9-db37245e1ada tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1314 microversion: 2.1 time: 0.166278 Aug 30 01:12:52.894436 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 174/359] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:52 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:53.880961 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-63427540-bafb-417c-9bbd-93cbd552b53d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:53.881599 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-63427540-bafb-417c-9bbd-93cbd552b53d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:53.888980 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63427540-bafb-417c-9bbd-93cbd552b53d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:53.889587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63427540-bafb-417c-9bbd-93cbd552b53d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:53.890032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63427540-bafb-417c-9bbd-93cbd552b53d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:53.891436 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63427540-bafb-417c-9bbd-93cbd552b53d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:53.891912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63427540-bafb-417c-9bbd-93cbd552b53d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:53.892348 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63427540-bafb-417c-9bbd-93cbd552b53d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:53.897089 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:53.922351 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e9067b8f-1fa1-44d6-a81d-1b170b82416a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:53.922351 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e9067b8f-1fa1-44d6-a81d-1b170b82416a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:53.933412 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9067b8f-1fa1-44d6-a81d-1b170b82416a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:53.933412 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9067b8f-1fa1-44d6-a81d-1b170b82416a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:53.933412 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9067b8f-1fa1-44d6-a81d-1b170b82416a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:53.933412 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9067b8f-1fa1-44d6-a81d-1b170b82416a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:53.934113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9067b8f-1fa1-44d6-a81d-1b170b82416a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:53.934777 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9067b8f-1fa1-44d6-a81d-1b170b82416a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:54.094873 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-63427540-bafb-417c-9bbd-93cbd552b53d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:54.107694 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-63427540-bafb-417c-9bbd-93cbd552b53d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.231983 Aug 30 01:12:54.108289 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 186/360] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:53 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:54.137920 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e9067b8f-1fa1-44d6-a81d-1b170b82416a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:54.146492 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e9067b8f-1fa1-44d6-a81d-1b170b82416a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1497 microversion: 2.1 time: 0.235019 Aug 30 01:12:54.147047 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 175/361] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:53 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1497 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:54.612035 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-297c8bc9-f187-4f91-a36d-a451d961bded tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:54.612557 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-297c8bc9-f187-4f91-a36d-a451d961bded tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:54.618619 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-297c8bc9-f187-4f91-a36d-a451d961bded tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:54.619099 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-297c8bc9-f187-4f91-a36d-a451d961bded tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:54.619538 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-297c8bc9-f187-4f91-a36d-a451d961bded tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:54.620267 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-297c8bc9-f187-4f91-a36d-a451d961bded tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:54.620720 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-297c8bc9-f187-4f91-a36d-a451d961bded tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:54.621136 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-297c8bc9-f187-4f91-a36d-a451d961bded tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:54.646087 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-297c8bc9-f187-4f91-a36d-a451d961bded tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/ips" status: 200 len: 151 microversion: 2.20 time: 0.038165 Aug 30 01:12:54.646661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 187/362] 10.222.0.52 () {60 vars in 1289 bytes} [Tue Aug 30 01:12:54 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:12:55.130083 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ddee622e-31dd-477d-a58e-4be6c1d7b30a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:55.130697 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ddee622e-31dd-477d-a58e-4be6c1d7b30a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:55.136878 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddee622e-31dd-477d-a58e-4be6c1d7b30a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:55.137367 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddee622e-31dd-477d-a58e-4be6c1d7b30a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:55.137829 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddee622e-31dd-477d-a58e-4be6c1d7b30a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:55.138531 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddee622e-31dd-477d-a58e-4be6c1d7b30a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:55.138990 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddee622e-31dd-477d-a58e-4be6c1d7b30a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:55.139416 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddee622e-31dd-477d-a58e-4be6c1d7b30a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:55.415180 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ddee622e-31dd-477d-a58e-4be6c1d7b30a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:55.424030 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ddee622e-31dd-477d-a58e-4be6c1d7b30a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.298588 Aug 30 01:12:55.424946 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 176/363] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:55 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:55.572554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-878a75e2-1b97-4e79-aee9-85aaf354d279 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32a160ed-a2a8-4376-8b17-b59bcab215b8"}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:12:55.574974 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-878a75e2-1b97-4e79-aee9-85aaf354d279 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:55.583076 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-878a75e2-1b97-4e79-aee9-85aaf354d279 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:55.583764 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-878a75e2-1b97-4e79-aee9-85aaf354d279 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:55.584057 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-878a75e2-1b97-4e79-aee9-85aaf354d279 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:55.584840 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-878a75e2-1b97-4e79-aee9-85aaf354d279 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:55.585218 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-878a75e2-1b97-4e79-aee9-85aaf354d279 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:55.586226 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-878a75e2-1b97-4e79-aee9-85aaf354d279 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:55.903775 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8d946abb-5e78-4bb3-b2b2-2890bab05254 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:55.904274 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8d946abb-5e78-4bb3-b2b2-2890bab05254 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:55.910550 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d946abb-5e78-4bb3-b2b2-2890bab05254 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:55.911033 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d946abb-5e78-4bb3-b2b2-2890bab05254 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:55.911466 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d946abb-5e78-4bb3-b2b2-2890bab05254 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:55.912234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d946abb-5e78-4bb3-b2b2-2890bab05254 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:55.912682 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d946abb-5e78-4bb3-b2b2-2890bab05254 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:55.913098 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d946abb-5e78-4bb3-b2b2-2890bab05254 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:55.938468 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8d946abb-5e78-4bb3-b2b2-2890bab05254 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:12:56.221438 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8d946abb-5e78-4bb3-b2b2-2890bab05254 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 204 len: 0 microversion: 2.1 time: 0.321162 Aug 30 01:12:56.222210 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 177/364] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:12:55 2022] DELETE /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 01:12:56.230682 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b4654669-91fc-4411-ae97-4dd84e29e260 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:56.231384 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b4654669-91fc-4411-ae97-4dd84e29e260 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:56.238713 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4654669-91fc-4411-ae97-4dd84e29e260 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:56.239201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4654669-91fc-4411-ae97-4dd84e29e260 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:56.239631 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4654669-91fc-4411-ae97-4dd84e29e260 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:56.240324 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4654669-91fc-4411-ae97-4dd84e29e260 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:56.240837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4654669-91fc-4411-ae97-4dd84e29e260 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:56.241246 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b4654669-91fc-4411-ae97-4dd84e29e260 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:56.246760 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:56.380198 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b4654669-91fc-4411-ae97-4dd84e29e260 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:56.387977 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b4654669-91fc-4411-ae97-4dd84e29e260 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1503 microversion: 2.1 time: 0.161302 Aug 30 01:12:56.388559 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 178/365] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:56 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:56.444600 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9873a9a9-e3df-4d03-9551-00f2e68e8780 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:56.445214 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9873a9a9-e3df-4d03-9551-00f2e68e8780 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:56.452690 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9873a9a9-e3df-4d03-9551-00f2e68e8780 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:56.453184 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9873a9a9-e3df-4d03-9551-00f2e68e8780 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:56.454261 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9873a9a9-e3df-4d03-9551-00f2e68e8780 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:56.461432 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9873a9a9-e3df-4d03-9551-00f2e68e8780 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:56.461432 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9873a9a9-e3df-4d03-9551-00f2e68e8780 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:56.461432 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9873a9a9-e3df-4d03-9551-00f2e68e8780 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:56.593181 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9873a9a9-e3df-4d03-9551-00f2e68e8780 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:56.601899 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9873a9a9-e3df-4d03-9551-00f2e68e8780 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.161194 Aug 30 01:12:56.602473 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 179/366] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:56 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:56.747389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-878a75e2-1b97-4e79-aee9-85aaf354d279 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "POST /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.178663 Aug 30 01:12:56.748005 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 188/367] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 30 01:12:55 2022] POST /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/os-volume_attachments => generated 194 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:12:57.410595 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-23eab037-37fb-48d0-809e-7121e9d08e7d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:57.411216 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-23eab037-37fb-48d0-809e-7121e9d08e7d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:57.413640 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:12:57.418575 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23eab037-37fb-48d0-809e-7121e9d08e7d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:57.419050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23eab037-37fb-48d0-809e-7121e9d08e7d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:57.419490 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23eab037-37fb-48d0-809e-7121e9d08e7d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:57.420209 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23eab037-37fb-48d0-809e-7121e9d08e7d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:57.420653 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23eab037-37fb-48d0-809e-7121e9d08e7d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:57.421068 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23eab037-37fb-48d0-809e-7121e9d08e7d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:57.553112 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-23eab037-37fb-48d0-809e-7121e9d08e7d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:57.561048 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-23eab037-37fb-48d0-809e-7121e9d08e7d tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1503 microversion: 2.1 time: 0.154768 Aug 30 01:12:57.561834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 180/368] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:57 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:57.624732 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-79da5bdf-4043-43c6-bdb7-5c0a3dc43b20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:57.625502 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-79da5bdf-4043-43c6-bdb7-5c0a3dc43b20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:57.631908 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-79da5bdf-4043-43c6-bdb7-5c0a3dc43b20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:57.632396 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-79da5bdf-4043-43c6-bdb7-5c0a3dc43b20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:57.632839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-79da5bdf-4043-43c6-bdb7-5c0a3dc43b20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:57.633534 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-79da5bdf-4043-43c6-bdb7-5c0a3dc43b20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:57.634024 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-79da5bdf-4043-43c6-bdb7-5c0a3dc43b20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:57.634452 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-79da5bdf-4043-43c6-bdb7-5c0a3dc43b20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:57.792701 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-79da5bdf-4043-43c6-bdb7-5c0a3dc43b20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:57.801849 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-79da5bdf-4043-43c6-bdb7-5c0a3dc43b20 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.181916 Aug 30 01:12:57.810894 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 189/369] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:57 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:57.837666 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bfee5213-4cbb-400f-a24e-b7568341647d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:12:57.838405 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bfee5213-4cbb-400f-a24e-b7568341647d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:57.845417 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfee5213-4cbb-400f-a24e-b7568341647d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:57.846262 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfee5213-4cbb-400f-a24e-b7568341647d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:57.846792 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfee5213-4cbb-400f-a24e-b7568341647d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:57.847596 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfee5213-4cbb-400f-a24e-b7568341647d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:57.848159 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfee5213-4cbb-400f-a24e-b7568341647d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:57.848739 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfee5213-4cbb-400f-a24e-b7568341647d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:57.884267 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-bfee5213-4cbb-400f-a24e-b7568341647d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lazy-loading 'flavor' on Instance uuid d4475905-983f-47fb-8b8e-6c87baeac22d {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:12:58.539739 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bfee5213-4cbb-400f-a24e-b7568341647d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "POST /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/action" status: 202 len: 0 microversion: 2.20 time: 0.712588 Aug 30 01:12:58.540334 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 181/370] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Aug 30 01:12:57 2022] POST /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:12:58.549722 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9bc48995-a8e1-41d6-a373-d3e64a74514f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:58.550345 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9bc48995-a8e1-41d6-a373-d3e64a74514f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:58.557330 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bc48995-a8e1-41d6-a373-d3e64a74514f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:58.558013 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bc48995-a8e1-41d6-a373-d3e64a74514f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:58.558712 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bc48995-a8e1-41d6-a373-d3e64a74514f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:58.559908 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bc48995-a8e1-41d6-a373-d3e64a74514f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:58.560534 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bc48995-a8e1-41d6-a373-d3e64a74514f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:58.560959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bc48995-a8e1-41d6-a373-d3e64a74514f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:58.584829 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bcdb6d02-e48b-4785-879a-af80fad4b13a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:58.585814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bcdb6d02-e48b-4785-879a-af80fad4b13a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:58.605937 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bcdb6d02-e48b-4785-879a-af80fad4b13a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:58.606451 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bcdb6d02-e48b-4785-879a-af80fad4b13a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:58.606982 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bcdb6d02-e48b-4785-879a-af80fad4b13a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:58.607606 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bcdb6d02-e48b-4785-879a-af80fad4b13a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:58.608093 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bcdb6d02-e48b-4785-879a-af80fad4b13a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:58.608578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bcdb6d02-e48b-4785-879a-af80fad4b13a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:58.729563 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9bc48995-a8e1-41d6-a373-d3e64a74514f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:58.740772 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9bc48995-a8e1-41d6-a373-d3e64a74514f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:58.742725 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9bc48995-a8e1-41d6-a373-d3e64a74514f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:58.744135 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9bc48995-a8e1-41d6-a373-d3e64a74514f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.199307 Aug 30 01:12:58.758635 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 190/371] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:12:58 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:12:58.831172 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5645b783-2281-457a-ae75-3cd178351fd5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:58.831851 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5645b783-2281-457a-ae75-3cd178351fd5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:58.838692 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5645b783-2281-457a-ae75-3cd178351fd5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:58.839182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5645b783-2281-457a-ae75-3cd178351fd5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:58.839620 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5645b783-2281-457a-ae75-3cd178351fd5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:58.840352 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5645b783-2281-457a-ae75-3cd178351fd5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:58.840855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5645b783-2281-457a-ae75-3cd178351fd5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:58.841283 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5645b783-2281-457a-ae75-3cd178351fd5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:58.858243 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bcdb6d02-e48b-4785-879a-af80fad4b13a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:58.866389 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bcdb6d02-e48b-4785-879a-af80fad4b13a tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1503 microversion: 2.1 time: 0.286736 Aug 30 01:12:58.867195 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 182/372] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:58 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1503 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:12:58.995914 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5645b783-2281-457a-ae75-3cd178351fd5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:59.007424 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5645b783-2281-457a-ae75-3cd178351fd5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.181668 Aug 30 01:12:59.008216 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 191/373] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:58 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:12:59.413414 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-96501a98-1662-4e70-ae60-c6f34f151888 req-f38bbb7d-5788-4b3a-a4c4-24f37e54de24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0604dba-37d3-4990-8ee6-38201f0fab53", "name": "network-vif-deleted", "tag": "2d5afc80-dacf-45bd-81f8-28c6788c55a4"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:12:59.425081 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-96501a98-1662-4e70-ae60-c6f34f151888 req-f38bbb7d-5788-4b3a-a4c4-24f37e54de24 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:59.425685 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-96501a98-1662-4e70-ae60-c6f34f151888 req-f38bbb7d-5788-4b3a-a4c4-24f37e54de24 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:59.426306 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-96501a98-1662-4e70-ae60-c6f34f151888 req-f38bbb7d-5788-4b3a-a4c4-24f37e54de24 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:59.438160 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-96501a98-1662-4e70-ae60-c6f34f151888 req-f38bbb7d-5788-4b3a-a4c4-24f37e54de24 service nova] Creating event network-vif-deleted:2d5afc80-dacf-45bd-81f8-28c6788c55a4 for instance e0604dba-37d3-4990-8ee6-38201f0fab53 on hv-cinder-81571 Aug 30 01:12:59.443698 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-96501a98-1662-4e70-ae60-c6f34f151888 req-f38bbb7d-5788-4b3a-a4c4-24f37e54de24 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033992 Aug 30 01:12:59.444289 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 183/374] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:12:59.770922 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5e0a14b6-8ffd-42e6-b103-e1ad5e3b7d9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:59.770922 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5e0a14b6-8ffd-42e6-b103-e1ad5e3b7d9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:59.776897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5e0a14b6-8ffd-42e6-b103-e1ad5e3b7d9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:59.777387 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5e0a14b6-8ffd-42e6-b103-e1ad5e3b7d9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:59.777885 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5e0a14b6-8ffd-42e6-b103-e1ad5e3b7d9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:59.778592 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5e0a14b6-8ffd-42e6-b103-e1ad5e3b7d9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:59.779227 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5e0a14b6-8ffd-42e6-b103-e1ad5e3b7d9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:59.779839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5e0a14b6-8ffd-42e6-b103-e1ad5e3b7d9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:59.889867 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5b5ecf8b-3799-4d19-b547-e7dc3b66d99e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:12:59.892958 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5b5ecf8b-3799-4d19-b547-e7dc3b66d99e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:12:59.902354 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b5ecf8b-3799-4d19-b547-e7dc3b66d99e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:59.903180 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b5ecf8b-3799-4d19-b547-e7dc3b66d99e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:59.903999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b5ecf8b-3799-4d19-b547-e7dc3b66d99e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:59.904928 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b5ecf8b-3799-4d19-b547-e7dc3b66d99e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:12:59.905601 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b5ecf8b-3799-4d19-b547-e7dc3b66d99e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:12:59.906319 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b5ecf8b-3799-4d19-b547-e7dc3b66d99e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:12:59.926975 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5e0a14b6-8ffd-42e6-b103-e1ad5e3b7d9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:59.935675 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5e0a14b6-8ffd-42e6-b103-e1ad5e3b7d9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:59.937124 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5e0a14b6-8ffd-42e6-b103-e1ad5e3b7d9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:59.938690 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5e0a14b6-8ffd-42e6-b103-e1ad5e3b7d9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.174427 Aug 30 01:12:59.939261 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 192/375] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:12:59 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:12:59.973541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5b5ecf8b-3799-4d19-b547-e7dc3b66d99e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:12:59.981501 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5b5ecf8b-3799-4d19-b547-e7dc3b66d99e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1299 microversion: 2.1 time: 0.095909 Aug 30 01:12:59.982184 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 184/376] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:12:59 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:00.028214 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a7b48f72-96f9-4287-9915-9475e8418a2a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:00.028832 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a7b48f72-96f9-4287-9915-9475e8418a2a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:00.035710 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a7b48f72-96f9-4287-9915-9475e8418a2a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:00.036202 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a7b48f72-96f9-4287-9915-9475e8418a2a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:00.036668 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a7b48f72-96f9-4287-9915-9475e8418a2a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:00.037388 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a7b48f72-96f9-4287-9915-9475e8418a2a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:00.037853 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a7b48f72-96f9-4287-9915-9475e8418a2a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:00.038287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a7b48f72-96f9-4287-9915-9475e8418a2a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:00.183139 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a7b48f72-96f9-4287-9915-9475e8418a2a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:00.191157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a7b48f72-96f9-4287-9915-9475e8418a2a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.166689 Aug 30 01:13:00.191733 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 193/377] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:00 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:00.962605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bdf60ccd-3cda-411b-a064-552b85ed8aa5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:00.964741 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bdf60ccd-3cda-411b-a064-552b85ed8aa5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:00.972958 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdf60ccd-3cda-411b-a064-552b85ed8aa5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:00.974273 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdf60ccd-3cda-411b-a064-552b85ed8aa5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:00.977957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdf60ccd-3cda-411b-a064-552b85ed8aa5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:00.977957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdf60ccd-3cda-411b-a064-552b85ed8aa5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:00.977957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdf60ccd-3cda-411b-a064-552b85ed8aa5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:00.977957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdf60ccd-3cda-411b-a064-552b85ed8aa5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:01.006797 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5e587813-7fe8-45ca-85ec-7892aa34363e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:01.008692 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5e587813-7fe8-45ca-85ec-7892aa34363e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:01.017846 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5e587813-7fe8-45ca-85ec-7892aa34363e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:01.018699 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5e587813-7fe8-45ca-85ec-7892aa34363e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:01.019296 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5e587813-7fe8-45ca-85ec-7892aa34363e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:01.020136 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5e587813-7fe8-45ca-85ec-7892aa34363e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:01.020832 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5e587813-7fe8-45ca-85ec-7892aa34363e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:01.021467 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5e587813-7fe8-45ca-85ec-7892aa34363e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:01.078030 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5e587813-7fe8-45ca-85ec-7892aa34363e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:01.079490 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5e587813-7fe8-45ca-85ec-7892aa34363e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:01.079939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5e587813-7fe8-45ca-85ec-7892aa34363e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:01.080409 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-5e587813-7fe8-45ca-85ec-7892aa34363e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lazy-loading 'fault' on Instance uuid e0604dba-37d3-4990-8ee6-38201f0fab53 {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:13:01.122637 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5e587813-7fe8-45ca-85ec-7892aa34363e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b225b55d18740c2833cade52edc556e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f140e0f58f42ae96e16f80b480621c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:01.133900 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5e587813-7fe8-45ca-85ec-7892aa34363e tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 200 len: 1304 microversion: 2.1 time: 0.132874 Aug 30 01:13:01.135477 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 194/378] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:00 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:01.148683 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bdf60ccd-3cda-411b-a064-552b85ed8aa5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:01.158303 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bdf60ccd-3cda-411b-a064-552b85ed8aa5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:01.159931 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bdf60ccd-3cda-411b-a064-552b85ed8aa5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:01.161191 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bdf60ccd-3cda-411b-a064-552b85ed8aa5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.203052 Aug 30 01:13:01.162043 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 185/379] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:00 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:01.212974 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-60b01d83-579e-4e3b-b0b8-787883b46cff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:01.213584 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-60b01d83-579e-4e3b-b0b8-787883b46cff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:01.219704 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60b01d83-579e-4e3b-b0b8-787883b46cff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:01.220177 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60b01d83-579e-4e3b-b0b8-787883b46cff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:01.224341 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60b01d83-579e-4e3b-b0b8-787883b46cff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:01.224341 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60b01d83-579e-4e3b-b0b8-787883b46cff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:01.224341 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60b01d83-579e-4e3b-b0b8-787883b46cff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:01.224341 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60b01d83-579e-4e3b-b0b8-787883b46cff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:01.357594 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-60b01d83-579e-4e3b-b0b8-787883b46cff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:01.365826 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-60b01d83-579e-4e3b-b0b8-787883b46cff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.156671 Aug 30 01:13:01.366814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 195/380] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:01 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:02.159415 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-610b4229-2b70-4709-b58d-e2713fb0fc31 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:02.160413 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-610b4229-2b70-4709-b58d-e2713fb0fc31 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] [instance: e0604dba-37d3-4990-8ee6-38201f0fab53] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:02.166539 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-610b4229-2b70-4709-b58d-e2713fb0fc31 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:02.167025 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-610b4229-2b70-4709-b58d-e2713fb0fc31 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:02.167465 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-610b4229-2b70-4709-b58d-e2713fb0fc31 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:02.168164 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-610b4229-2b70-4709-b58d-e2713fb0fc31 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:02.168645 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-610b4229-2b70-4709-b58d-e2713fb0fc31 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:02.169294 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-610b4229-2b70-4709-b58d-e2713fb0fc31 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:02.185629 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-610b4229-2b70-4709-b58d-e2713fb0fc31 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] HTTP exception thrown: Instance e0604dba-37d3-4990-8ee6-38201f0fab53 could not be found. Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-610b4229-2b70-4709-b58d-e2713fb0fc31 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Request method failure captured: Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 HTTP/1.1 Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWPVACdaWjxBawMWHirfR6iEnRQP4VLCRuudRH5fJ6Cli5Wy8jxhdfqq4ejeLSHWudCGXwtMA1Nf3Z2oqHYqhIdtm5c2sgrEwr66lwHBgZSevK-Ao51kRn5wUMdRvFmDK_nFVMpC9cKIJpEwgYt9MfIcG8EHuuDq4mydRF4DtiMNG8s Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 43f140e0f58f42ae96e16f80b480621c Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesActionsTest-2123755706 Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:13:02.188331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:13:02.189976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/43f140e0f58f42ae96e16f80b480621c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_43f140e0f58f42ae96e16f80b480621c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/43f140e0f58f42ae96e16f80b480621c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/43f140e0f58f42ae96e16f80b480621c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:13:02.189976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesActionsTest-2123755706 Aug 30 01:13:02.189976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 43f140e0f58f42ae96e16f80b480621c Aug 30 01:13:02.189976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesActionsTest-2123755706 Aug 30 01:13:02.189976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesActionsTest-2123755706-project Aug 30 01:13:02.189976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:13:02.189976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:13:02.189976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 1b225b55d18740c2833cade52edc556e Aug 30 01:13:02.189976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesActionsTest-2123755706-project Aug 30 01:13:02.189976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:13:02.189976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance e0604dba-37d3-4990-8ee6-38201f0fab53 could not be found. Aug 30 01:13:02.189976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': 'e0604dba-37d3-4990-8ee6-38201f0fab53'} Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0604dba-37d3-4990-8ee6-38201f0fab53 could not be found. Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:13:02.190657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0604dba-37d3-4990-8ee6-38201f0fab53 could not be found. Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0604dba-37d3-4990-8ee6-38201f0fab53 could not be found. Aug 30 01:13:02.191975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:13:02.192991 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-610b4229-2b70-4709-b58d-e2713fb0fc31 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] Returning 404 to user: Instance e0604dba-37d3-4990-8ee6-38201f0fab53 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:13:02.192991 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-610b4229-2b70-4709-b58d-e2713fb0fc31 tempest-VolumesActionsTest-2123755706 tempest-VolumesActionsTest-2123755706-project] 10.222.0.52 "GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53" status: 404 len: 111 microversion: 2.1 time: 0.034862 Aug 30 01:13:02.192991 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 186/381] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:02 2022] GET /compute/v2.1/servers/e0604dba-37d3-4990-8ee6-38201f0fab53 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:13:02.193869 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-7c86aa8f-1727-4f54-b8e2-1ebde8e6d3aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:02.194709 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-7c86aa8f-1727-4f54-b8e2-1ebde8e6d3aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:02.202564 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7c86aa8f-1727-4f54-b8e2-1ebde8e6d3aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:02.202961 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7c86aa8f-1727-4f54-b8e2-1ebde8e6d3aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:02.203397 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7c86aa8f-1727-4f54-b8e2-1ebde8e6d3aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:02.204310 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7c86aa8f-1727-4f54-b8e2-1ebde8e6d3aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:02.204966 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7c86aa8f-1727-4f54-b8e2-1ebde8e6d3aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:02.205477 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7c86aa8f-1727-4f54-b8e2-1ebde8e6d3aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:02.339121 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7c86aa8f-1727-4f54-b8e2-1ebde8e6d3aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:02.347830 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7c86aa8f-1727-4f54-b8e2-1ebde8e6d3aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:02.349723 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7c86aa8f-1727-4f54-b8e2-1ebde8e6d3aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:02.350476 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-7c86aa8f-1727-4f54-b8e2-1ebde8e6d3aa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.164555 Aug 30 01:13:02.351049 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 196/382] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:02 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:02.387634 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-01fa59a1-cc86-4169-9996-7fcfd1e28caf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:02.388623 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-01fa59a1-cc86-4169-9996-7fcfd1e28caf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:02.395598 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01fa59a1-cc86-4169-9996-7fcfd1e28caf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:02.396090 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01fa59a1-cc86-4169-9996-7fcfd1e28caf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:02.396528 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01fa59a1-cc86-4169-9996-7fcfd1e28caf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:02.397230 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01fa59a1-cc86-4169-9996-7fcfd1e28caf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:02.397687 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01fa59a1-cc86-4169-9996-7fcfd1e28caf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:02.398154 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01fa59a1-cc86-4169-9996-7fcfd1e28caf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:02.545706 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-01fa59a1-cc86-4169-9996-7fcfd1e28caf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:02.557157 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-01fa59a1-cc86-4169-9996-7fcfd1e28caf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.173289 Aug 30 01:13:02.574362 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 187/383] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:02 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:03.373087 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-60326214-7f03-46b4-ad05-fdd8efd26fe2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:03.373752 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-60326214-7f03-46b4-ad05-fdd8efd26fe2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:03.376920 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=66 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:03.381698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60326214-7f03-46b4-ad05-fdd8efd26fe2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:03.382216 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60326214-7f03-46b4-ad05-fdd8efd26fe2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:03.382653 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60326214-7f03-46b4-ad05-fdd8efd26fe2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:03.383379 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60326214-7f03-46b4-ad05-fdd8efd26fe2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:03.383847 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60326214-7f03-46b4-ad05-fdd8efd26fe2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:03.384268 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60326214-7f03-46b4-ad05-fdd8efd26fe2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:03.525170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-60326214-7f03-46b4-ad05-fdd8efd26fe2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:03.534318 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-60326214-7f03-46b4-ad05-fdd8efd26fe2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:03.535768 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-60326214-7f03-46b4-ad05-fdd8efd26fe2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:03.536981 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-60326214-7f03-46b4-ad05-fdd8efd26fe2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.167773 Aug 30 01:13:03.537646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 197/384] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:03 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:03.580017 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ab28e397-3506-46f0-a314-281c0e514b9b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:03.580649 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ab28e397-3506-46f0-a314-281c0e514b9b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:03.586620 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab28e397-3506-46f0-a314-281c0e514b9b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:03.587091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab28e397-3506-46f0-a314-281c0e514b9b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:03.587520 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab28e397-3506-46f0-a314-281c0e514b9b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:03.588200 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab28e397-3506-46f0-a314-281c0e514b9b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:03.588644 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab28e397-3506-46f0-a314-281c0e514b9b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:03.589062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab28e397-3506-46f0-a314-281c0e514b9b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:03.606245 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a9c5de3f-9656-4f91-8109-fddda96109bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:03.606734 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a9c5de3f-9656-4f91-8109-fddda96109bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:03.613097 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a9c5de3f-9656-4f91-8109-fddda96109bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:03.613565 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a9c5de3f-9656-4f91-8109-fddda96109bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:03.614095 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a9c5de3f-9656-4f91-8109-fddda96109bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:03.614777 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a9c5de3f-9656-4f91-8109-fddda96109bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:03.615223 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a9c5de3f-9656-4f91-8109-fddda96109bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:03.615637 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a9c5de3f-9656-4f91-8109-fddda96109bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:03.640255 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a9c5de3f-9656-4f91-8109-fddda96109bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/ips" status: 200 len: 150 microversion: 2.1 time: 0.037846 Aug 30 01:13:03.641811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 198/385] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 30 01:13:03 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:13:03.733892 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ab28e397-3506-46f0-a314-281c0e514b9b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:03.743152 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ab28e397-3506-46f0-a314-281c0e514b9b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.167307 Aug 30 01:13:03.743741 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 188/386] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:03 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:04.560715 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-15ca2713-bcd7-4a30-b693-9a2eda3769eb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:04.563895 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-15ca2713-bcd7-4a30-b693-9a2eda3769eb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:04.569407 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15ca2713-bcd7-4a30-b693-9a2eda3769eb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:04.570045 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15ca2713-bcd7-4a30-b693-9a2eda3769eb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:04.570657 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15ca2713-bcd7-4a30-b693-9a2eda3769eb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:04.571432 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15ca2713-bcd7-4a30-b693-9a2eda3769eb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:04.571973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15ca2713-bcd7-4a30-b693-9a2eda3769eb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:04.572813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15ca2713-bcd7-4a30-b693-9a2eda3769eb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:04.712162 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-15ca2713-bcd7-4a30-b693-9a2eda3769eb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:04.720769 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-15ca2713-bcd7-4a30-b693-9a2eda3769eb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:04.722151 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-15ca2713-bcd7-4a30-b693-9a2eda3769eb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:04.723301 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-15ca2713-bcd7-4a30-b693-9a2eda3769eb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.166586 Aug 30 01:13:04.724506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 199/387] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:04 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:04.766409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1f6a157f-a7b5-4a8a-8599-017d8a1e570b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:04.767442 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1f6a157f-a7b5-4a8a-8599-017d8a1e570b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:04.773551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f6a157f-a7b5-4a8a-8599-017d8a1e570b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:04.774332 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f6a157f-a7b5-4a8a-8599-017d8a1e570b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:04.774779 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f6a157f-a7b5-4a8a-8599-017d8a1e570b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:04.775488 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f6a157f-a7b5-4a8a-8599-017d8a1e570b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:04.775951 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f6a157f-a7b5-4a8a-8599-017d8a1e570b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:04.776381 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f6a157f-a7b5-4a8a-8599-017d8a1e570b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:04.914772 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1f6a157f-a7b5-4a8a-8599-017d8a1e570b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:04.922951 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1f6a157f-a7b5-4a8a-8599-017d8a1e570b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.161159 Aug 30 01:13:04.923528 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 189/388] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:04 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:05.746862 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0835aa55-51dc-46ce-acf6-f93dbc3e3992 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:05.747470 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0835aa55-51dc-46ce-acf6-f93dbc3e3992 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:05.754183 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0835aa55-51dc-46ce-acf6-f93dbc3e3992 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:05.754673 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0835aa55-51dc-46ce-acf6-f93dbc3e3992 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:05.755126 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0835aa55-51dc-46ce-acf6-f93dbc3e3992 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:05.755810 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0835aa55-51dc-46ce-acf6-f93dbc3e3992 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:05.756265 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0835aa55-51dc-46ce-acf6-f93dbc3e3992 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:05.756689 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0835aa55-51dc-46ce-acf6-f93dbc3e3992 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:05.887438 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0835aa55-51dc-46ce-acf6-f93dbc3e3992 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:05.895823 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0835aa55-51dc-46ce-acf6-f93dbc3e3992 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:05.897254 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0835aa55-51dc-46ce-acf6-f93dbc3e3992 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:05.898540 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0835aa55-51dc-46ce-acf6-f93dbc3e3992 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.155579 Aug 30 01:13:05.899096 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 200/389] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:05 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:05.943725 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e03d0018-eaa5-4290-b07e-ae533f45eb69 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:05.944329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e03d0018-eaa5-4290-b07e-ae533f45eb69 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:05.950261 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e03d0018-eaa5-4290-b07e-ae533f45eb69 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:05.950737 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e03d0018-eaa5-4290-b07e-ae533f45eb69 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:05.951171 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e03d0018-eaa5-4290-b07e-ae533f45eb69 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:05.951848 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e03d0018-eaa5-4290-b07e-ae533f45eb69 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:05.952296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e03d0018-eaa5-4290-b07e-ae533f45eb69 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:05.952714 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e03d0018-eaa5-4290-b07e-ae533f45eb69 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:06.085429 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e03d0018-eaa5-4290-b07e-ae533f45eb69 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:06.093248 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e03d0018-eaa5-4290-b07e-ae533f45eb69 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.153297 Aug 30 01:13:06.093766 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 190/390] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:05 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:06.922781 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e440427e-f1f6-4988-889d-aa201a96eee5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:06.923581 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e440427e-f1f6-4988-889d-aa201a96eee5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:06.931780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e440427e-f1f6-4988-889d-aa201a96eee5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:06.932295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e440427e-f1f6-4988-889d-aa201a96eee5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:06.932748 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e440427e-f1f6-4988-889d-aa201a96eee5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:06.936014 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e440427e-f1f6-4988-889d-aa201a96eee5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:06.936014 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e440427e-f1f6-4988-889d-aa201a96eee5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:06.936014 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e440427e-f1f6-4988-889d-aa201a96eee5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:07.068627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e440427e-f1f6-4988-889d-aa201a96eee5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:07.072106 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:07.077102 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e440427e-f1f6-4988-889d-aa201a96eee5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:07.078578 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e440427e-f1f6-4988-889d-aa201a96eee5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:07.079740 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e440427e-f1f6-4988-889d-aa201a96eee5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.162060 Aug 30 01:13:07.080298 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 201/391] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:06 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:07.115491 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d6611a0a-b151-41b0-9736-299dab41101f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:07.116022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d6611a0a-b151-41b0-9736-299dab41101f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:07.122032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6611a0a-b151-41b0-9736-299dab41101f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:07.122556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6611a0a-b151-41b0-9736-299dab41101f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:07.123001 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6611a0a-b151-41b0-9736-299dab41101f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:07.123687 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6611a0a-b151-41b0-9736-299dab41101f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:07.124150 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6611a0a-b151-41b0-9736-299dab41101f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:07.124572 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6611a0a-b151-41b0-9736-299dab41101f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:07.255196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d6611a0a-b151-41b0-9736-299dab41101f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:07.263053 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d6611a0a-b151-41b0-9736-299dab41101f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.152199 Aug 30 01:13:07.263619 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 191/392] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:07 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:07.554972 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-3fa90988-f6c4-4578-922a-7b24d8b1e538 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8184703f-e584-47b6-9a3f-80ca49b4ac67"}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:07.557435 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-3fa90988-f6c4-4578-922a-7b24d8b1e538 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:07.564324 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3fa90988-f6c4-4578-922a-7b24d8b1e538 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:07.564799 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3fa90988-f6c4-4578-922a-7b24d8b1e538 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:07.565233 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3fa90988-f6c4-4578-922a-7b24d8b1e538 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:07.565953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3fa90988-f6c4-4578-922a-7b24d8b1e538 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:07.566406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3fa90988-f6c4-4578-922a-7b24d8b1e538 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:07.566825 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3fa90988-f6c4-4578-922a-7b24d8b1e538 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:08.103066 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f8386648-eddb-4d3f-85fd-1396f2d4145a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:08.104235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f8386648-eddb-4d3f-85fd-1396f2d4145a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:08.114014 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8386648-eddb-4d3f-85fd-1396f2d4145a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:08.115671 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8386648-eddb-4d3f-85fd-1396f2d4145a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:08.117392 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8386648-eddb-4d3f-85fd-1396f2d4145a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:08.118621 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8386648-eddb-4d3f-85fd-1396f2d4145a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:08.119347 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8386648-eddb-4d3f-85fd-1396f2d4145a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:08.119983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8386648-eddb-4d3f-85fd-1396f2d4145a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:08.327115 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f8386648-eddb-4d3f-85fd-1396f2d4145a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:08.337064 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f8386648-eddb-4d3f-85fd-1396f2d4145a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:08.338754 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f8386648-eddb-4d3f-85fd-1396f2d4145a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:08.340003 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f8386648-eddb-4d3f-85fd-1396f2d4145a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.241442 Aug 30 01:13:08.340864 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 192/393] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:08 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:13:08.345717 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6d8819f2-2cf9-4051-84d5-48defd5524e0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:08.346513 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6d8819f2-2cf9-4051-84d5-48defd5524e0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:08.356902 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d8819f2-2cf9-4051-84d5-48defd5524e0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:08.357715 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d8819f2-2cf9-4051-84d5-48defd5524e0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:08.358655 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d8819f2-2cf9-4051-84d5-48defd5524e0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:08.359602 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d8819f2-2cf9-4051-84d5-48defd5524e0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:08.360124 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d8819f2-2cf9-4051-84d5-48defd5524e0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:08.360622 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d8819f2-2cf9-4051-84d5-48defd5524e0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:08.526081 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6d8819f2-2cf9-4051-84d5-48defd5524e0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:08.536229 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6d8819f2-2cf9-4051-84d5-48defd5524e0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.193614 Aug 30 01:13:08.537195 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 193/394] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:08 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:09.370128 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d4de3afa-9062-4257-b113-875f12457a61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:09.371957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d4de3afa-9062-4257-b113-875f12457a61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:09.380840 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4de3afa-9062-4257-b113-875f12457a61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:09.381883 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4de3afa-9062-4257-b113-875f12457a61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:09.382642 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4de3afa-9062-4257-b113-875f12457a61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:09.383769 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4de3afa-9062-4257-b113-875f12457a61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:09.384450 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4de3afa-9062-4257-b113-875f12457a61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:09.386150 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4de3afa-9062-4257-b113-875f12457a61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:09.392347 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:09.734176 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d4de3afa-9062-4257-b113-875f12457a61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:09.744353 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d4de3afa-9062-4257-b113-875f12457a61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:09.746533 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d4de3afa-9062-4257-b113-875f12457a61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:09.747863 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d4de3afa-9062-4257-b113-875f12457a61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.382727 Aug 30 01:13:09.748670 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 194/395] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:09 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:09.754165 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-874453ee-a3df-43e0-b566-3288c91a19ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:09.755505 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-874453ee-a3df-43e0-b566-3288c91a19ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:09.767990 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-874453ee-a3df-43e0-b566-3288c91a19ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:09.769194 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-874453ee-a3df-43e0-b566-3288c91a19ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:09.770139 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-874453ee-a3df-43e0-b566-3288c91a19ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:09.771184 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-874453ee-a3df-43e0-b566-3288c91a19ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:09.771868 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-874453ee-a3df-43e0-b566-3288c91a19ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:09.772476 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-874453ee-a3df-43e0-b566-3288c91a19ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:09.854895 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-3fa90988-f6c4-4578-922a-7b24d8b1e538 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "POST /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.303081 Aug 30 01:13:09.856750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 202/396] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 30 01:13:07 2022] POST /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/os-volume_attachments => generated 194 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:13:09.889840 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0ecad4e5-a38d-42f3-a58c-6ca9365b4d92 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:09.912790 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0ecad4e5-a38d-42f3-a58c-6ca9365b4d92 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:09.915891 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0ecad4e5-a38d-42f3-a58c-6ca9365b4d92 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:09.915891 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0ecad4e5-a38d-42f3-a58c-6ca9365b4d92 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:10.058146 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-874453ee-a3df-43e0-b566-3288c91a19ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:10.068708 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-874453ee-a3df-43e0-b566-3288c91a19ff tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1502 microversion: 2.1 time: 0.318357 Aug 30 01:13:10.069818 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 195/397] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:09 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1502 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:10.095321 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cd887a79-f03f-4bd5-aeff-541a6ebfeb85 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64682dc3-8fb6-429e-94b8-5ceb00faffe7"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:10.098631 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cd887a79-f03f-4bd5-aeff-541a6ebfeb85 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:10.108410 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd887a79-f03f-4bd5-aeff-541a6ebfeb85 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:10.109039 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd887a79-f03f-4bd5-aeff-541a6ebfeb85 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:10.109721 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd887a79-f03f-4bd5-aeff-541a6ebfeb85 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:10.110563 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd887a79-f03f-4bd5-aeff-541a6ebfeb85 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:10.111186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd887a79-f03f-4bd5-aeff-541a6ebfeb85 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:10.111838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd887a79-f03f-4bd5-aeff-541a6ebfeb85 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:10.118187 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0ecad4e5-a38d-42f3-a58c-6ca9365b4d92 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Going to try to stop instance {{(pid=121233) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 01:13:10.148134 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-cd887a79-f03f-4bd5-aeff-541a6ebfeb85 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] HTTP exception thrown: Cannot 'attach_volume' instance e1388d14-c15e-4f95-9b68-944001f0d53a while it is in vm_state rescued Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cd887a79-f03f-4bd5-aeff-541a6ebfeb85 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Request method failure captured: Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: POST /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a/os-volume_attachments HTTP/1.1 Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 74 Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWOeQEJvJe1oPgcAM0CJuHJZAsxaDOqgO7QH27qraPSKUTsAC4XPuYjUu6EVHrur_xArtWyqCb5JWbnssK7EJqykgUjLDeCSyIoPGge8kiHjsHWrlFHhD6AcbhjW0-wlasX1OPO3NkTkkmdkpMoIb_wVF9xmCsbss_a5nytHoL3C3Tw Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 9f0605a8a2fe48e49a410127b5f3b32c Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1432841125 Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:13:10.150060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:13:10.151669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:13:10.151669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1432841125 Aug 30 01:13:10.151669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 9f0605a8a2fe48e49a410127b5f3b32c Aug 30 01:13:10.151669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1432841125 Aug 30 01:13:10.151669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-ServerRescueNegativeTestJSON-1432841125-project Aug 30 01:13:10.151669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:13:10.151669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:13:10.151669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 76ea3ed3bb2b412093004c7e0f49c7ce Aug 30 01:13:10.151669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1432841125-project Aug 30 01:13:10.151669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Aug 30 01:13:10.151669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {"volumeAttachment": {"volumeId": "64682dc3-8fb6-429e-94b8-5ceb00faffe7"}} Aug 30 01:13:10.151669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Cannot 'attach_volume' instance e1388d14-c15e-4f95-9b68-944001f0d53a while it is in vm_state rescued Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'server_id': 'e1388d14-c15e-4f95-9b68-944001f0d53a', 'body': {'volumeAttachment': {'volumeId': '64682dc3-8fb6-429e-94b8-5ceb00faffe7'}}} Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e1388d14-c15e-4f95-9b68-944001f0d53a in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:13:10.152481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e1388d14-c15e-4f95-9b68-944001f0d53a while it is in vm_state rescued Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:13:10.153605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:13:10.155241 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:13:10.155241 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:13:10.155241 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e1388d14-c15e-4f95-9b68-944001f0d53a while it is in vm_state rescued Aug 30 01:13:10.155241 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:13:10.155241 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cd887a79-f03f-4bd5-aeff-541a6ebfeb85 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Returning 409 to user: Cannot 'attach_volume' instance e1388d14-c15e-4f95-9b68-944001f0d53a while it is in vm_state rescued {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:13:10.155241 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cd887a79-f03f-4bd5-aeff-541a6ebfeb85 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "POST /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.062814 Aug 30 01:13:10.155241 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 196/398] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 30 01:13:10 2022] POST /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a/os-volume_attachments => generated 152 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 01:13:10.172959 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-10976d65-ce4e-4368-abd7-50a9cf275d43 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:10.173858 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-10976d65-ce4e-4368-abd7-50a9cf275d43 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:10.181334 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10976d65-ce4e-4368-abd7-50a9cf275d43 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:10.182237 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10976d65-ce4e-4368-abd7-50a9cf275d43 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:10.182880 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10976d65-ce4e-4368-abd7-50a9cf275d43 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:10.183792 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10976d65-ce4e-4368-abd7-50a9cf275d43 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:10.184474 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10976d65-ce4e-4368-abd7-50a9cf275d43 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:10.185109 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10976d65-ce4e-4368-abd7-50a9cf275d43 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:10.345827 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0ecad4e5-a38d-42f3-a58c-6ca9365b4d92 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "POST /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/action" status: 202 len: 0 microversion: 2.1 time: 0.487100 Aug 30 01:13:10.346858 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 203/399] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 30 01:13:09 2022] POST /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:13:10.365872 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-70339531-e9a3-4aaf-b104-7454bd030963 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:10.370019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-70339531-e9a3-4aaf-b104-7454bd030963 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:10.378724 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-70339531-e9a3-4aaf-b104-7454bd030963 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:10.379387 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-70339531-e9a3-4aaf-b104-7454bd030963 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:10.380461 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-70339531-e9a3-4aaf-b104-7454bd030963 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:10.381670 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-70339531-e9a3-4aaf-b104-7454bd030963 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:10.382249 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-70339531-e9a3-4aaf-b104-7454bd030963 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:10.384220 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-70339531-e9a3-4aaf-b104-7454bd030963 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:10.415597 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-10976d65-ce4e-4368-abd7-50a9cf275d43 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "POST /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a/action" status: 202 len: 0 microversion: 2.1 time: 0.251110 Aug 30 01:13:10.415597 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 197/400] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 30 01:13:10 2022] POST /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:13:10.432294 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2c7031b6-a485-4b09-8697-19b0b2587f41 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:10.433429 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2c7031b6-a485-4b09-8697-19b0b2587f41 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:10.441211 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c7031b6-a485-4b09-8697-19b0b2587f41 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:10.442173 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c7031b6-a485-4b09-8697-19b0b2587f41 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:10.443128 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c7031b6-a485-4b09-8697-19b0b2587f41 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:10.444311 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c7031b6-a485-4b09-8697-19b0b2587f41 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:10.445095 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c7031b6-a485-4b09-8697-19b0b2587f41 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:10.445721 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c7031b6-a485-4b09-8697-19b0b2587f41 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:10.569083 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-70339531-e9a3-4aaf-b104-7454bd030963 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:10.581851 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-70339531-e9a3-4aaf-b104-7454bd030963 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1723 microversion: 2.1 time: 0.229110 Aug 30 01:13:10.599380 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 204/401] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:10 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:10.699485 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2c7031b6-a485-4b09-8697-19b0b2587f41 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:10.720101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2c7031b6-a485-4b09-8697-19b0b2587f41 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1510 microversion: 2.1 time: 0.294575 Aug 30 01:13:10.720101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 198/402] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:10 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:10.789932 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0e0889d4-dc5d-4223-ae5c-3def2360260d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:10.790552 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0e0889d4-dc5d-4223-ae5c-3def2360260d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:10.800591 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0e0889d4-dc5d-4223-ae5c-3def2360260d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:10.801085 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0e0889d4-dc5d-4223-ae5c-3def2360260d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:10.801568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0e0889d4-dc5d-4223-ae5c-3def2360260d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:10.802312 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0e0889d4-dc5d-4223-ae5c-3def2360260d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:10.802771 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0e0889d4-dc5d-4223-ae5c-3def2360260d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:10.803194 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0e0889d4-dc5d-4223-ae5c-3def2360260d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:10.984741 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0e0889d4-dc5d-4223-ae5c-3def2360260d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:10.993910 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0e0889d4-dc5d-4223-ae5c-3def2360260d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:10.995415 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0e0889d4-dc5d-4223-ae5c-3def2360260d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:10.996574 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0e0889d4-dc5d-4223-ae5c-3def2360260d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.214448 Aug 30 01:13:10.997131 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 205/403] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:10 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:11.605756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-45d60cba-c9bb-46e1-b62c-44d2c459199c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:11.606546 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-45d60cba-c9bb-46e1-b62c-44d2c459199c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:11.614428 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45d60cba-c9bb-46e1-b62c-44d2c459199c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:11.615444 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45d60cba-c9bb-46e1-b62c-44d2c459199c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:11.615967 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45d60cba-c9bb-46e1-b62c-44d2c459199c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:11.616917 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45d60cba-c9bb-46e1-b62c-44d2c459199c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:11.617589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45d60cba-c9bb-46e1-b62c-44d2c459199c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:11.618304 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45d60cba-c9bb-46e1-b62c-44d2c459199c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:11.752135 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-3969787d-bd86-4800-be49-1976968ae7ca tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:11.752703 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-3969787d-bd86-4800-be49-1976968ae7ca tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:11.759618 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3969787d-bd86-4800-be49-1976968ae7ca tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:11.760107 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3969787d-bd86-4800-be49-1976968ae7ca tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:11.760545 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3969787d-bd86-4800-be49-1976968ae7ca tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:11.761644 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3969787d-bd86-4800-be49-1976968ae7ca tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:11.761959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3969787d-bd86-4800-be49-1976968ae7ca tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:11.762377 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3969787d-bd86-4800-be49-1976968ae7ca tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:11.793238 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-45d60cba-c9bb-46e1-b62c-44d2c459199c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:11.803842 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-45d60cba-c9bb-46e1-b62c-44d2c459199c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1723 microversion: 2.1 time: 0.202176 Aug 30 01:13:11.804438 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 199/404] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:11 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:11.948516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-3969787d-bd86-4800-be49-1976968ae7ca tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:11.969552 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-3969787d-bd86-4800-be49-1976968ae7ca tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1510 microversion: 2.1 time: 0.221415 Aug 30 01:13:11.970481 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 206/405] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:11 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1510 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:12.020681 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e9064b7f-52f9-4904-bfe2-9f9925fd2ffc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:12.021294 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e9064b7f-52f9-4904-bfe2-9f9925fd2ffc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:12.028913 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9064b7f-52f9-4904-bfe2-9f9925fd2ffc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:12.029448 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9064b7f-52f9-4904-bfe2-9f9925fd2ffc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:12.029887 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9064b7f-52f9-4904-bfe2-9f9925fd2ffc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:12.030689 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9064b7f-52f9-4904-bfe2-9f9925fd2ffc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:12.031048 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9064b7f-52f9-4904-bfe2-9f9925fd2ffc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:12.031476 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9064b7f-52f9-4904-bfe2-9f9925fd2ffc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:12.174674 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e9064b7f-52f9-4904-bfe2-9f9925fd2ffc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:12.183729 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e9064b7f-52f9-4904-bfe2-9f9925fd2ffc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:12.185182 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e9064b7f-52f9-4904-bfe2-9f9925fd2ffc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:12.186384 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e9064b7f-52f9-4904-bfe2-9f9925fd2ffc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.170138 Aug 30 01:13:12.192180 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 200/406] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:12 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:12.833778 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4c5cd0fe-ffe2-4f2f-9ce9-5bd706baee49 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:12.835149 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4c5cd0fe-ffe2-4f2f-9ce9-5bd706baee49 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:12.854425 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4c5cd0fe-ffe2-4f2f-9ce9-5bd706baee49 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:12.854947 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4c5cd0fe-ffe2-4f2f-9ce9-5bd706baee49 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:12.855385 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4c5cd0fe-ffe2-4f2f-9ce9-5bd706baee49 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:12.856104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4c5cd0fe-ffe2-4f2f-9ce9-5bd706baee49 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:12.856567 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4c5cd0fe-ffe2-4f2f-9ce9-5bd706baee49 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:12.856997 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4c5cd0fe-ffe2-4f2f-9ce9-5bd706baee49 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:12.992508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b601360d-47fe-42f8-a24b-169f40c80d5a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:12.993131 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b601360d-47fe-42f8-a24b-169f40c80d5a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:12.999788 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b601360d-47fe-42f8-a24b-169f40c80d5a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:13.000532 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b601360d-47fe-42f8-a24b-169f40c80d5a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:13.001318 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b601360d-47fe-42f8-a24b-169f40c80d5a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:13.002387 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b601360d-47fe-42f8-a24b-169f40c80d5a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:13.003017 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b601360d-47fe-42f8-a24b-169f40c80d5a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:13.003606 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b601360d-47fe-42f8-a24b-169f40c80d5a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:13.018796 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4c5cd0fe-ffe2-4f2f-9ce9-5bd706baee49 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:13.029020 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4c5cd0fe-ffe2-4f2f-9ce9-5bd706baee49 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1723 microversion: 2.1 time: 0.206029 Aug 30 01:13:13.034116 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 207/407] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:12 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:13.158241 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b601360d-47fe-42f8-a24b-169f40c80d5a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:13.167845 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b601360d-47fe-42f8-a24b-169f40c80d5a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1510 microversion: 2.1 time: 0.180162 Aug 30 01:13:13.168705 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 201/408] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:12 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:13.211988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f0f3f49d-50e2-43c8-ac50-d0efe6eea109 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:13.212750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f0f3f49d-50e2-43c8-ac50-d0efe6eea109 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:13.220967 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0f3f49d-50e2-43c8-ac50-d0efe6eea109 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:13.221456 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0f3f49d-50e2-43c8-ac50-d0efe6eea109 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:13.221924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0f3f49d-50e2-43c8-ac50-d0efe6eea109 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:13.222625 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0f3f49d-50e2-43c8-ac50-d0efe6eea109 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:13.223244 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0f3f49d-50e2-43c8-ac50-d0efe6eea109 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:13.223828 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0f3f49d-50e2-43c8-ac50-d0efe6eea109 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:13.391925 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f0f3f49d-50e2-43c8-ac50-d0efe6eea109 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:13.406828 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f0f3f49d-50e2-43c8-ac50-d0efe6eea109 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:13.409883 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f0f3f49d-50e2-43c8-ac50-d0efe6eea109 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:13.411669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f0f3f49d-50e2-43c8-ac50-d0efe6eea109 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.204178 Aug 30 01:13:13.413535 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 208/409] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:13 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:14.053061 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bcdd07a7-a98a-4608-bee3-4722cbbcd8df tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:14.054354 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bcdd07a7-a98a-4608-bee3-4722cbbcd8df tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:14.069068 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bcdd07a7-a98a-4608-bee3-4722cbbcd8df tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:14.069883 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bcdd07a7-a98a-4608-bee3-4722cbbcd8df tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:14.070491 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bcdd07a7-a98a-4608-bee3-4722cbbcd8df tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:14.071571 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bcdd07a7-a98a-4608-bee3-4722cbbcd8df tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:14.072263 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bcdd07a7-a98a-4608-bee3-4722cbbcd8df tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:14.072906 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bcdd07a7-a98a-4608-bee3-4722cbbcd8df tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:14.193295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-70ed925d-195c-4e29-890a-061faa6bed05 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:14.194338 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-70ed925d-195c-4e29-890a-061faa6bed05 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:14.203643 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-70ed925d-195c-4e29-890a-061faa6bed05 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:14.204208 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-70ed925d-195c-4e29-890a-061faa6bed05 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:14.204644 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-70ed925d-195c-4e29-890a-061faa6bed05 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:14.205344 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-70ed925d-195c-4e29-890a-061faa6bed05 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:14.206131 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-70ed925d-195c-4e29-890a-061faa6bed05 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:14.206909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-70ed925d-195c-4e29-890a-061faa6bed05 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:14.308878 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bcdd07a7-a98a-4608-bee3-4722cbbcd8df tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:14.322831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bcdd07a7-a98a-4608-bee3-4722cbbcd8df tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1723 microversion: 2.1 time: 0.274358 Aug 30 01:13:14.324238 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 202/410] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:14 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:14.405639 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-70ed925d-195c-4e29-890a-061faa6bed05 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:14.415207 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-70ed925d-195c-4e29-890a-061faa6bed05 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1510 microversion: 2.1 time: 0.228219 Aug 30 01:13:14.418043 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 209/411] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:14 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:14.442975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-18279ecc-e57c-430e-9d88-9c36ec82b8e5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:14.447468 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-18279ecc-e57c-430e-9d88-9c36ec82b8e5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:14.450115 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18279ecc-e57c-430e-9d88-9c36ec82b8e5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:14.450610 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18279ecc-e57c-430e-9d88-9c36ec82b8e5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:14.451046 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18279ecc-e57c-430e-9d88-9c36ec82b8e5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:14.451783 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18279ecc-e57c-430e-9d88-9c36ec82b8e5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:14.452253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18279ecc-e57c-430e-9d88-9c36ec82b8e5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:14.452668 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18279ecc-e57c-430e-9d88-9c36ec82b8e5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:14.630955 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-18279ecc-e57c-430e-9d88-9c36ec82b8e5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:14.640789 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-18279ecc-e57c-430e-9d88-9c36ec82b8e5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:14.642772 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-18279ecc-e57c-430e-9d88-9c36ec82b8e5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:14.644489 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-18279ecc-e57c-430e-9d88-9c36ec82b8e5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.205911 Aug 30 01:13:14.646118 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 203/412] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:14 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:15.347711 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e41ada5a-0fde-460f-8f5e-387cb8730de3 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:15.349321 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e41ada5a-0fde-460f-8f5e-387cb8730de3 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:15.359293 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e41ada5a-0fde-460f-8f5e-387cb8730de3 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:15.360556 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e41ada5a-0fde-460f-8f5e-387cb8730de3 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:15.362643 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e41ada5a-0fde-460f-8f5e-387cb8730de3 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:15.364835 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e41ada5a-0fde-460f-8f5e-387cb8730de3 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:15.365987 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e41ada5a-0fde-460f-8f5e-387cb8730de3 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:15.367089 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e41ada5a-0fde-460f-8f5e-387cb8730de3 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:15.439186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-aa518969-0a2e-4654-b3d5-ee13d520be5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:15.442687 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-aa518969-0a2e-4654-b3d5-ee13d520be5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:15.455914 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa518969-0a2e-4654-b3d5-ee13d520be5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:15.458442 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa518969-0a2e-4654-b3d5-ee13d520be5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:15.459709 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa518969-0a2e-4654-b3d5-ee13d520be5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:15.461540 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa518969-0a2e-4654-b3d5-ee13d520be5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:15.462491 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa518969-0a2e-4654-b3d5-ee13d520be5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:15.463945 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa518969-0a2e-4654-b3d5-ee13d520be5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:15.545185 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e41ada5a-0fde-460f-8f5e-387cb8730de3 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:15.556876 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e41ada5a-0fde-460f-8f5e-387cb8730de3 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1723 microversion: 2.1 time: 0.212919 Aug 30 01:13:15.558754 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 210/413] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:15 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:15.671085 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-aa518969-0a2e-4654-b3d5-ee13d520be5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:15.674401 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0dcb2d63-7a8e-4a27-b700-bbf668dcd9da tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:15.675328 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0dcb2d63-7a8e-4a27-b700-bbf668dcd9da tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:15.691261 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-aa518969-0a2e-4654-b3d5-ee13d520be5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1510 microversion: 2.1 time: 0.256411 Aug 30 01:13:15.692479 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0dcb2d63-7a8e-4a27-b700-bbf668dcd9da tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:15.693196 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0dcb2d63-7a8e-4a27-b700-bbf668dcd9da tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:15.706809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0dcb2d63-7a8e-4a27-b700-bbf668dcd9da tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:15.707611 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0dcb2d63-7a8e-4a27-b700-bbf668dcd9da tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:15.708183 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0dcb2d63-7a8e-4a27-b700-bbf668dcd9da tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:15.708625 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0dcb2d63-7a8e-4a27-b700-bbf668dcd9da tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:15.710732 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 204/414] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:15 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1510 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:15.857190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0dcb2d63-7a8e-4a27-b700-bbf668dcd9da tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:15.866230 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0dcb2d63-7a8e-4a27-b700-bbf668dcd9da tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:15.867666 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0dcb2d63-7a8e-4a27-b700-bbf668dcd9da tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:15.869069 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0dcb2d63-7a8e-4a27-b700-bbf668dcd9da tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.204886 Aug 30 01:13:15.869926 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 211/415] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:15 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:13:16.590399 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7b045d24-6a7f-4ffd-921e-97a018fabd32 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:16.591061 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7b045d24-6a7f-4ffd-921e-97a018fabd32 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:16.597427 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b045d24-6a7f-4ffd-921e-97a018fabd32 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:16.598270 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b045d24-6a7f-4ffd-921e-97a018fabd32 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:16.598911 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b045d24-6a7f-4ffd-921e-97a018fabd32 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:16.599857 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b045d24-6a7f-4ffd-921e-97a018fabd32 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:16.600542 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b045d24-6a7f-4ffd-921e-97a018fabd32 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:16.601171 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b045d24-6a7f-4ffd-921e-97a018fabd32 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:16.719982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-75978c54-f37f-46b7-82c6-ec162ab790b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:16.720894 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-75978c54-f37f-46b7-82c6-ec162ab790b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:16.730803 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75978c54-f37f-46b7-82c6-ec162ab790b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:16.736510 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75978c54-f37f-46b7-82c6-ec162ab790b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:16.736510 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75978c54-f37f-46b7-82c6-ec162ab790b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:16.736510 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75978c54-f37f-46b7-82c6-ec162ab790b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:16.736510 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75978c54-f37f-46b7-82c6-ec162ab790b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:16.736999 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75978c54-f37f-46b7-82c6-ec162ab790b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:16.879351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-75978c54-f37f-46b7-82c6-ec162ab790b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:16.890517 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-75978c54-f37f-46b7-82c6-ec162ab790b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1510 microversion: 2.1 time: 0.174647 Aug 30 01:13:16.891542 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 212/416] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:16 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:16.897401 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c72daa2c-3180-4f8b-ae92-2fe813b336b7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:16.898044 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c72daa2c-3180-4f8b-ae92-2fe813b336b7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:16.904779 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c72daa2c-3180-4f8b-ae92-2fe813b336b7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:16.905271 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c72daa2c-3180-4f8b-ae92-2fe813b336b7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:16.905693 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c72daa2c-3180-4f8b-ae92-2fe813b336b7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:16.906423 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c72daa2c-3180-4f8b-ae92-2fe813b336b7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:16.906871 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c72daa2c-3180-4f8b-ae92-2fe813b336b7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:16.907290 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c72daa2c-3180-4f8b-ae92-2fe813b336b7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:17.008814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7b045d24-6a7f-4ffd-921e-97a018fabd32 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:17.019050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7b045d24-6a7f-4ffd-921e-97a018fabd32 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1723 microversion: 2.1 time: 0.434369 Aug 30 01:13:17.019628 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 205/417] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:16 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1723 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:17.103180 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c72daa2c-3180-4f8b-ae92-2fe813b336b7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:17.115867 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c72daa2c-3180-4f8b-ae92-2fe813b336b7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:17.118349 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c72daa2c-3180-4f8b-ae92-2fe813b336b7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:17.119790 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c72daa2c-3180-4f8b-ae92-2fe813b336b7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.226912 Aug 30 01:13:17.120481 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 213/418] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:16 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:17.924102 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8e34d5d6-182c-4452-bd90-ed9936383fa5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:17.925506 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8e34d5d6-182c-4452-bd90-ed9936383fa5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:17.939448 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e34d5d6-182c-4452-bd90-ed9936383fa5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:17.939448 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e34d5d6-182c-4452-bd90-ed9936383fa5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:17.939448 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e34d5d6-182c-4452-bd90-ed9936383fa5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:17.941031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e34d5d6-182c-4452-bd90-ed9936383fa5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:17.942716 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e34d5d6-182c-4452-bd90-ed9936383fa5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:17.943840 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e34d5d6-182c-4452-bd90-ed9936383fa5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:18.044874 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-885285c9-b61f-46f4-a8bf-6ff11237e593 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:18.049416 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-885285c9-b61f-46f4-a8bf-6ff11237e593 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:18.062137 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-885285c9-b61f-46f4-a8bf-6ff11237e593 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:18.063772 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-885285c9-b61f-46f4-a8bf-6ff11237e593 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:18.065021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-885285c9-b61f-46f4-a8bf-6ff11237e593 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:18.067872 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-885285c9-b61f-46f4-a8bf-6ff11237e593 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:18.069494 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-885285c9-b61f-46f4-a8bf-6ff11237e593 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:18.070602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-885285c9-b61f-46f4-a8bf-6ff11237e593 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:18.150192 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8e34d5d6-182c-4452-bd90-ed9936383fa5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:18.159370 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8e34d5d6-182c-4452-bd90-ed9936383fa5 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1510 microversion: 2.1 time: 0.247624 Aug 30 01:13:18.174159 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 206/419] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:17 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1510 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:18.179962 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ab5caf68-85cf-4602-b105-4f5484bcbb53 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:18.180803 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ab5caf68-85cf-4602-b105-4f5484bcbb53 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:18.187944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab5caf68-85cf-4602-b105-4f5484bcbb53 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:18.188625 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab5caf68-85cf-4602-b105-4f5484bcbb53 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:18.189403 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab5caf68-85cf-4602-b105-4f5484bcbb53 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:18.190316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab5caf68-85cf-4602-b105-4f5484bcbb53 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:18.190926 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab5caf68-85cf-4602-b105-4f5484bcbb53 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:18.191528 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab5caf68-85cf-4602-b105-4f5484bcbb53 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:18.268127 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-885285c9-b61f-46f4-a8bf-6ff11237e593 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:18.277378 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-885285c9-b61f-46f4-a8bf-6ff11237e593 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1723 microversion: 2.1 time: 0.237866 Aug 30 01:13:18.292243 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 214/420] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:18 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:18.369851 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ab5caf68-85cf-4602-b105-4f5484bcbb53 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:18.385205 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ab5caf68-85cf-4602-b105-4f5484bcbb53 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:18.387186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ab5caf68-85cf-4602-b105-4f5484bcbb53 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:18.389078 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ab5caf68-85cf-4602-b105-4f5484bcbb53 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.213593 Aug 30 01:13:18.402091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 207/421] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:18 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:19.181571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f92a0e82-e22e-462c-92ce-8cd1136bbc19 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:19.182203 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f92a0e82-e22e-462c-92ce-8cd1136bbc19 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:19.188530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f92a0e82-e22e-462c-92ce-8cd1136bbc19 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:19.189019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f92a0e82-e22e-462c-92ce-8cd1136bbc19 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:19.189646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f92a0e82-e22e-462c-92ce-8cd1136bbc19 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:19.190453 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f92a0e82-e22e-462c-92ce-8cd1136bbc19 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:19.190944 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f92a0e82-e22e-462c-92ce-8cd1136bbc19 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:19.191410 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f92a0e82-e22e-462c-92ce-8cd1136bbc19 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:19.304196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dc69946c-cfb6-4c20-ae7e-240a4f238faf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:19.305214 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dc69946c-cfb6-4c20-ae7e-240a4f238faf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:19.321259 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc69946c-cfb6-4c20-ae7e-240a4f238faf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:19.322602 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc69946c-cfb6-4c20-ae7e-240a4f238faf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:19.324434 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc69946c-cfb6-4c20-ae7e-240a4f238faf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:19.326474 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc69946c-cfb6-4c20-ae7e-240a4f238faf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:19.327768 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc69946c-cfb6-4c20-ae7e-240a4f238faf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:19.329128 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc69946c-cfb6-4c20-ae7e-240a4f238faf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:19.349710 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f92a0e82-e22e-462c-92ce-8cd1136bbc19 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:19.358124 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f92a0e82-e22e-462c-92ce-8cd1136bbc19 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1510 microversion: 2.1 time: 0.180745 Aug 30 01:13:19.358747 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 215/422] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:19 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:19.414063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-98632070-d9c6-4d4b-aab3-38240617201f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:19.415045 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-98632070-d9c6-4d4b-aab3-38240617201f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:19.429954 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-98632070-d9c6-4d4b-aab3-38240617201f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:19.434870 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-98632070-d9c6-4d4b-aab3-38240617201f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:19.434870 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-98632070-d9c6-4d4b-aab3-38240617201f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:19.434870 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-98632070-d9c6-4d4b-aab3-38240617201f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:19.434870 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-98632070-d9c6-4d4b-aab3-38240617201f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:19.435308 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-98632070-d9c6-4d4b-aab3-38240617201f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:19.437915 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:19.584165 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dc69946c-cfb6-4c20-ae7e-240a4f238faf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:19.591285 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-98632070-d9c6-4d4b-aab3-38240617201f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:19.617610 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-98632070-d9c6-4d4b-aab3-38240617201f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:19.623983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-98632070-d9c6-4d4b-aab3-38240617201f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:19.623983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-98632070-d9c6-4d4b-aab3-38240617201f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.211185 Aug 30 01:13:19.626656 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dc69946c-cfb6-4c20-ae7e-240a4f238faf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1723 microversion: 2.1 time: 0.329686 Aug 30 01:13:19.627866 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 208/423] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:19 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:19.628256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 216/424] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:19 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:20.400046 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0df5605e-6c9d-4e8a-90cc-819f55cc7657 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:20.400678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0df5605e-6c9d-4e8a-90cc-819f55cc7657 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:20.408228 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0df5605e-6c9d-4e8a-90cc-819f55cc7657 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:20.408228 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0df5605e-6c9d-4e8a-90cc-819f55cc7657 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:20.408228 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0df5605e-6c9d-4e8a-90cc-819f55cc7657 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:20.408721 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0df5605e-6c9d-4e8a-90cc-819f55cc7657 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:20.409182 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0df5605e-6c9d-4e8a-90cc-819f55cc7657 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:20.409605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0df5605e-6c9d-4e8a-90cc-819f55cc7657 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:20.580903 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0df5605e-6c9d-4e8a-90cc-819f55cc7657 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:20.590492 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0df5605e-6c9d-4e8a-90cc-819f55cc7657 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1516 microversion: 2.1 time: 0.194215 Aug 30 01:13:20.591095 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 209/425] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:20 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:20.649953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ab5f50ba-be08-4873-9478-feccadbe9a48 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:20.650729 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ab5f50ba-be08-4873-9478-feccadbe9a48 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:20.659128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ab5f50ba-be08-4873-9478-feccadbe9a48 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:20.659624 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ab5f50ba-be08-4873-9478-feccadbe9a48 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:20.660063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ab5f50ba-be08-4873-9478-feccadbe9a48 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:20.661287 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-94714709-5493-44f1-a3bc-cfbed44989d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:20.661430 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ab5f50ba-be08-4873-9478-feccadbe9a48 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:20.661978 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ab5f50ba-be08-4873-9478-feccadbe9a48 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:20.662363 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-94714709-5493-44f1-a3bc-cfbed44989d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:20.662488 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ab5f50ba-be08-4873-9478-feccadbe9a48 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:20.674492 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94714709-5493-44f1-a3bc-cfbed44989d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:20.676301 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94714709-5493-44f1-a3bc-cfbed44989d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:20.676954 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94714709-5493-44f1-a3bc-cfbed44989d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:20.680733 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94714709-5493-44f1-a3bc-cfbed44989d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:20.681210 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94714709-5493-44f1-a3bc-cfbed44989d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:20.681642 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94714709-5493-44f1-a3bc-cfbed44989d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:20.687892 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:20.883575 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ab5f50ba-be08-4873-9478-feccadbe9a48 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:20.894446 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ab5f50ba-be08-4873-9478-feccadbe9a48 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1723 microversion: 2.1 time: 0.249532 Aug 30 01:13:20.909753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 217/426] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:20 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:20.914618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-94714709-5493-44f1-a3bc-cfbed44989d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:20.924540 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-94714709-5493-44f1-a3bc-cfbed44989d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:20.928168 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-94714709-5493-44f1-a3bc-cfbed44989d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:20.928973 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-94714709-5493-44f1-a3bc-cfbed44989d8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.272504 Aug 30 01:13:20.929807 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 210/427] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:20 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:13:21.917488 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c943dbce-9da9-491f-b6bb-195ffc801535 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:21.918126 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c943dbce-9da9-491f-b6bb-195ffc801535 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:21.925037 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c943dbce-9da9-491f-b6bb-195ffc801535 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:21.925512 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c943dbce-9da9-491f-b6bb-195ffc801535 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:21.926002 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c943dbce-9da9-491f-b6bb-195ffc801535 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:21.926724 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c943dbce-9da9-491f-b6bb-195ffc801535 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:21.927167 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c943dbce-9da9-491f-b6bb-195ffc801535 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:21.927589 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c943dbce-9da9-491f-b6bb-195ffc801535 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:21.952564 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-57410264-e26d-4e41-82c0-805e4d05435e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:21.953130 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-57410264-e26d-4e41-82c0-805e4d05435e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:21.959989 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57410264-e26d-4e41-82c0-805e4d05435e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:21.960486 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57410264-e26d-4e41-82c0-805e4d05435e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:21.960925 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57410264-e26d-4e41-82c0-805e4d05435e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:21.961621 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57410264-e26d-4e41-82c0-805e4d05435e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:21.962114 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57410264-e26d-4e41-82c0-805e4d05435e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:21.962636 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57410264-e26d-4e41-82c0-805e4d05435e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:22.085128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c943dbce-9da9-491f-b6bb-195ffc801535 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:22.096823 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c943dbce-9da9-491f-b6bb-195ffc801535 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1723 microversion: 2.1 time: 0.183113 Aug 30 01:13:22.110510 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 218/428] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:21 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:22.154940 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-57410264-e26d-4e41-82c0-805e4d05435e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:22.165555 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-57410264-e26d-4e41-82c0-805e4d05435e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:22.167025 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-57410264-e26d-4e41-82c0-805e4d05435e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:22.168188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-57410264-e26d-4e41-82c0-805e4d05435e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.219616 Aug 30 01:13:22.168748 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 211/429] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:21 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:13:22.514518 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0fce862e-7bf0-4709-b32b-c9c9854cb3ea tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Action: 'create', calling method: .version_select at 0x7fd71d1cf3a0>, body: {"keypair": {"name": "tempest-keypair-1208263142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMveNwV0S1lcJe+aR2+5UVCVAnMbhm7i/9IqxDqlEsrZu0H6lk0OBHErkcbPhNXynxbUTiHg3N8NUWBfwYjUZXYwAIlNPjQaYf7i1pHk/IjzUDsSjiTsnuJykI5D90euGA=="}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:22.563250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-0fce862e-7bf0-4709-b32b-c9c9854cb3ea tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Getting quotas for project 9f0605a8a2fe48e49a410127b5f3b32c. Resources: {'key_pairs'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:13:22.568522 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-0fce862e-7bf0-4709-b32b-c9c9854cb3ea tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Getting quotas for user 76ea3ed3bb2b412093004c7e0f49c7ce and project 9f0605a8a2fe48e49a410127b5f3b32c. Resources: {'key_pairs'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:13:22.686303 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0fce862e-7bf0-4709-b32b-c9c9854cb3ea tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.175589 Aug 30 01:13:22.688097 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 219/430] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 30 01:13:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:13:23.118928 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1e59e9ca-0311-4dcc-84a1-7a9aed236ec8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:23.120278 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1e59e9ca-0311-4dcc-84a1-7a9aed236ec8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:23.134459 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e59e9ca-0311-4dcc-84a1-7a9aed236ec8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:23.135120 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e59e9ca-0311-4dcc-84a1-7a9aed236ec8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:23.135830 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e59e9ca-0311-4dcc-84a1-7a9aed236ec8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:23.136633 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e59e9ca-0311-4dcc-84a1-7a9aed236ec8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:23.137514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e59e9ca-0311-4dcc-84a1-7a9aed236ec8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:23.138091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e59e9ca-0311-4dcc-84a1-7a9aed236ec8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:23.193636 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c2bf8143-9bbd-48f9-a6a5-2fcaf9cfcff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:23.196274 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c2bf8143-9bbd-48f9-a6a5-2fcaf9cfcff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:23.216998 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c2bf8143-9bbd-48f9-a6a5-2fcaf9cfcff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:23.218005 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c2bf8143-9bbd-48f9-a6a5-2fcaf9cfcff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:23.218756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c2bf8143-9bbd-48f9-a6a5-2fcaf9cfcff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:23.219866 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c2bf8143-9bbd-48f9-a6a5-2fcaf9cfcff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:23.220656 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c2bf8143-9bbd-48f9-a6a5-2fcaf9cfcff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:23.221242 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c2bf8143-9bbd-48f9-a6a5-2fcaf9cfcff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:23.374248 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1e59e9ca-0311-4dcc-84a1-7a9aed236ec8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:23.385552 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1e59e9ca-0311-4dcc-84a1-7a9aed236ec8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1723 microversion: 2.1 time: 0.270467 Aug 30 01:13:23.386376 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 212/431] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:23 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:23.408143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c2bf8143-9bbd-48f9-a6a5-2fcaf9cfcff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:23.422268 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c2bf8143-9bbd-48f9-a6a5-2fcaf9cfcff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:23.425289 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c2bf8143-9bbd-48f9-a6a5-2fcaf9cfcff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:23.427499 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c2bf8143-9bbd-48f9-a6a5-2fcaf9cfcff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.239937 Aug 30 01:13:23.428922 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 220/432] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:23 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:24.409017 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-84f0edb2-c765-43a8-9c61-65f90d0f1767 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:24.409880 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-84f0edb2-c765-43a8-9c61-65f90d0f1767 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:24.422962 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84f0edb2-c765-43a8-9c61-65f90d0f1767 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:24.426908 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84f0edb2-c765-43a8-9c61-65f90d0f1767 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:24.426908 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84f0edb2-c765-43a8-9c61-65f90d0f1767 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:24.427793 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84f0edb2-c765-43a8-9c61-65f90d0f1767 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:24.428384 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84f0edb2-c765-43a8-9c61-65f90d0f1767 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:24.428902 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84f0edb2-c765-43a8-9c61-65f90d0f1767 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:24.455076 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5316dc44-457c-43e1-9663-85c3d5e76aea tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:24.460515 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5316dc44-457c-43e1-9663-85c3d5e76aea tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:24.467223 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5316dc44-457c-43e1-9663-85c3d5e76aea tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:24.470553 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5316dc44-457c-43e1-9663-85c3d5e76aea tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:24.471100 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5316dc44-457c-43e1-9663-85c3d5e76aea tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:24.471907 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5316dc44-457c-43e1-9663-85c3d5e76aea tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:24.472445 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5316dc44-457c-43e1-9663-85c3d5e76aea tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:24.473490 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5316dc44-457c-43e1-9663-85c3d5e76aea tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:24.625418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5316dc44-457c-43e1-9663-85c3d5e76aea tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:24.648793 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5316dc44-457c-43e1-9663-85c3d5e76aea tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:24.653849 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5316dc44-457c-43e1-9663-85c3d5e76aea tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:24.654256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5316dc44-457c-43e1-9663-85c3d5e76aea tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.205086 Aug 30 01:13:24.655202 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 221/433] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:24 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:24.750097 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-84f0edb2-c765-43a8-9c61-65f90d0f1767 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:24.762070 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-84f0edb2-c765-43a8-9c61-65f90d0f1767 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1723 microversion: 2.1 time: 0.358144 Aug 30 01:13:24.762961 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 213/434] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:24 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1723 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:25.680063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-851490f6-fd02-4738-8b17-f1a08676cd42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:25.681239 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-851490f6-fd02-4738-8b17-f1a08676cd42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:25.695959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-851490f6-fd02-4738-8b17-f1a08676cd42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:25.697113 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-851490f6-fd02-4738-8b17-f1a08676cd42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:25.697113 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-851490f6-fd02-4738-8b17-f1a08676cd42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:25.697748 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-851490f6-fd02-4738-8b17-f1a08676cd42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:25.698206 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-851490f6-fd02-4738-8b17-f1a08676cd42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:25.698628 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-851490f6-fd02-4738-8b17-f1a08676cd42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:25.793393 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f670fa70-2609-4daa-b19d-c241bc8a574e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:25.793393 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f670fa70-2609-4daa-b19d-c241bc8a574e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:25.793973 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f670fa70-2609-4daa-b19d-c241bc8a574e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:25.795966 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f670fa70-2609-4daa-b19d-c241bc8a574e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:25.797578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f670fa70-2609-4daa-b19d-c241bc8a574e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:25.802119 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f670fa70-2609-4daa-b19d-c241bc8a574e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:25.804789 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f670fa70-2609-4daa-b19d-c241bc8a574e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:25.805262 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f670fa70-2609-4daa-b19d-c241bc8a574e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:25.870555 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-851490f6-fd02-4738-8b17-f1a08676cd42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:25.880210 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-851490f6-fd02-4738-8b17-f1a08676cd42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:25.881752 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-851490f6-fd02-4738-8b17-f1a08676cd42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:25.883185 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-851490f6-fd02-4738-8b17-f1a08676cd42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1744 microversion: 2.20 time: 0.208868 Aug 30 01:13:25.883781 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 222/435] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:25 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1744 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:25.903863 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1064102275", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac8d987a-03fa-42da-829e-4cee4dd670a9"}], "security_groups": [{"name": "tempest-securitygroup--455689338"}], "key_name": "tempest-keypair-1208263142", "user_data": "}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:25.948705 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f670fa70-2609-4daa-b19d-c241bc8a574e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:25.959624 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f670fa70-2609-4daa-b19d-c241bc8a574e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1723 microversion: 2.1 time: 0.179045 Aug 30 01:13:25.973478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 214/436] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:25 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:26.027471 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.network.neutron [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] validate_networks() for [('ac8d987a-03fa-42da-829e-4cee4dd670a9', None, None, None, None, None)] {{(pid=121233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:13:26.281018 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8cc121fa-745f-4b86-8477-4909c38558ee tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Action: 'create', calling method: .version_select at 0x7fd71d397ee0>, body: {"keypair": {"name": "tempest-keypair-2063945513", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ82nxT5TxB0icdSP1tSpCyDQmmWb2HwFTl/0mrfqpu2wmaht/lh29eaqBTkrCwq1J7HNxJjvlpxKX71r0rcjaG7SB4hwWyBO24XvA0jZ4Mu4fId4MCSSjVittPkbknPlQ=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:26.316320 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-8cc121fa-745f-4b86-8477-4909c38558ee tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Getting quotas for project 11c8f48af7394a75ab6013ca066751a7. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:13:26.329127 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-8cc121fa-745f-4b86-8477-4909c38558ee tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Getting quotas for user 942d175e7e2742728e66fea84c851038 and project 11c8f48af7394a75ab6013ca066751a7. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:13:26.460049 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8cc121fa-745f-4b86-8477-4909c38558ee tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.181904 Aug 30 01:13:26.475722 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 215/437] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 30 01:13:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:13:26.500956 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Flavor limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:13:26.501271 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Image limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:13:26.501673 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Flavor pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:13:26.504995 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Image pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:13:26.504995 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:13:26.528105 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:26.528599 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:26.529036 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:26.529803 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:26.530265 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:26.530694 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:26.547625 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Getting quotas for project 9f0605a8a2fe48e49a410127b5f3b32c. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:13:26.551809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Getting quotas for user 76ea3ed3bb2b412093004c7e0f49c7ce and project 9f0605a8a2fe48e49a410127b5f3b32c. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:13:26.563012 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Going to run 1 instances... {{(pid=121233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:13:26.565320 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:13:26.722054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d8a71057-e2a3-414b-a28a-ab44a04c7af3 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.823162 Aug 30 01:13:26.722844 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 223/438] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:13:25 2022] POST /compute/v2.1/servers => generated 408 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:13:26.733886 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-40ee1348-cb5a-4e80-88b6-af22f47ed90d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:26.734553 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-40ee1348-cb5a-4e80-88b6-af22f47ed90d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:26.791666 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-40ee1348-cb5a-4e80-88b6-af22f47ed90d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:26.799940 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-40ee1348-cb5a-4e80-88b6-af22f47ed90d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1246 microversion: 2.1 time: 0.070142 Aug 30 01:13:26.800644 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 216/439] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:26 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1246 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:26.915482 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a94167b4-f3d3-4d29-aade-077168040a10 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:26.915482 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a94167b4-f3d3-4d29-aade-077168040a10 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:26.923511 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a94167b4-f3d3-4d29-aade-077168040a10 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:26.924372 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a94167b4-f3d3-4d29-aade-077168040a10 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:26.924977 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a94167b4-f3d3-4d29-aade-077168040a10 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:26.926286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a94167b4-f3d3-4d29-aade-077168040a10 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:26.926781 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a94167b4-f3d3-4d29-aade-077168040a10 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:26.927367 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a94167b4-f3d3-4d29-aade-077168040a10 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:26.983021 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-41343556-f405-4795-818a-d03fac0dbea6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:26.983743 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-41343556-f405-4795-818a-d03fac0dbea6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:26.991380 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41343556-f405-4795-818a-d03fac0dbea6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:26.993243 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41343556-f405-4795-818a-d03fac0dbea6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:26.993519 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41343556-f405-4795-818a-d03fac0dbea6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:26.994292 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41343556-f405-4795-818a-d03fac0dbea6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:26.994758 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41343556-f405-4795-818a-d03fac0dbea6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:26.995187 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41343556-f405-4795-818a-d03fac0dbea6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:27.111685 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a94167b4-f3d3-4d29-aade-077168040a10 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:27.121786 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a94167b4-f3d3-4d29-aade-077168040a10 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:27.123757 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a94167b4-f3d3-4d29-aade-077168040a10 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:27.125612 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a94167b4-f3d3-4d29-aade-077168040a10 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1744 microversion: 2.20 time: 0.219900 Aug 30 01:13:27.126673 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 224/440] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:26 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1744 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:27.161848 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-41343556-f405-4795-818a-d03fac0dbea6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:27.170392 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-41343556-f405-4795-818a-d03fac0dbea6 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1700 microversion: 2.1 time: 0.191460 Aug 30 01:13:27.171165 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 217/441] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:26 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1700 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:27.196036 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c20e9697-854d-4b08-a7fd-f68d128b4e9d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:27.202143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c20e9697-854d-4b08-a7fd-f68d128b4e9d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:27.202618 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c20e9697-854d-4b08-a7fd-f68d128b4e9d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:27.203048 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c20e9697-854d-4b08-a7fd-f68d128b4e9d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:27.229705 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c20e9697-854d-4b08-a7fd-f68d128b4e9d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Going to try to start instance {{(pid=121233) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 01:13:27.487043 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c20e9697-854d-4b08-a7fd-f68d128b4e9d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "POST /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/action" status: 202 len: 0 microversion: 2.1 time: 0.295308 Aug 30 01:13:27.494644 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 225/442] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 30 01:13:27 2022] POST /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:13:27.505636 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5d9ee14f-d6e1-4f95-b145-88b70c8ee7f5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:27.506360 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5d9ee14f-d6e1-4f95-b145-88b70c8ee7f5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:27.513386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d9ee14f-d6e1-4f95-b145-88b70c8ee7f5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:27.514167 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d9ee14f-d6e1-4f95-b145-88b70c8ee7f5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:27.514781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d9ee14f-d6e1-4f95-b145-88b70c8ee7f5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:27.516388 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d9ee14f-d6e1-4f95-b145-88b70c8ee7f5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:27.517036 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d9ee14f-d6e1-4f95-b145-88b70c8ee7f5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:27.517629 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d9ee14f-d6e1-4f95-b145-88b70c8ee7f5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:27.662946 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5d9ee14f-d6e1-4f95-b145-88b70c8ee7f5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:27.681218 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5d9ee14f-d6e1-4f95-b145-88b70c8ee7f5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1709 microversion: 2.1 time: 0.181757 Aug 30 01:13:27.681825 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 218/443] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:27 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1709 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:27.822065 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-299a7974-dad0-4269-b801-abd59ed6e4f6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:27.822872 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-299a7974-dad0-4269-b801-abd59ed6e4f6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:27.830430 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-299a7974-dad0-4269-b801-abd59ed6e4f6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:27.831437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-299a7974-dad0-4269-b801-abd59ed6e4f6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:27.831861 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-299a7974-dad0-4269-b801-abd59ed6e4f6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:27.833098 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-299a7974-dad0-4269-b801-abd59ed6e4f6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:27.833647 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-299a7974-dad0-4269-b801-abd59ed6e4f6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:27.834025 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-299a7974-dad0-4269-b801-abd59ed6e4f6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:27.900628 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-299a7974-dad0-4269-b801-abd59ed6e4f6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:27.908264 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-299a7974-dad0-4269-b801-abd59ed6e4f6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1250 microversion: 2.1 time: 0.091379 Aug 30 01:13:27.908842 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 226/444] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:27 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1250 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:28.151046 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dd0f2534-2c3c-4eea-85c7-a5cd71e17b58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:28.151680 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dd0f2534-2c3c-4eea-85c7-a5cd71e17b58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:28.153650 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:28.158685 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd0f2534-2c3c-4eea-85c7-a5cd71e17b58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:28.159294 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd0f2534-2c3c-4eea-85c7-a5cd71e17b58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:28.159918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd0f2534-2c3c-4eea-85c7-a5cd71e17b58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:28.160910 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd0f2534-2c3c-4eea-85c7-a5cd71e17b58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:28.161451 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd0f2534-2c3c-4eea-85c7-a5cd71e17b58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:28.161897 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd0f2534-2c3c-4eea-85c7-a5cd71e17b58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:28.500133 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dd0f2534-2c3c-4eea-85c7-a5cd71e17b58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:28.515813 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dd0f2534-2c3c-4eea-85c7-a5cd71e17b58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:28.517591 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dd0f2534-2c3c-4eea-85c7-a5cd71e17b58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:28.518903 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dd0f2534-2c3c-4eea-85c7-a5cd71e17b58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1744 microversion: 2.20 time: 0.371867 Aug 30 01:13:28.519504 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 219/445] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:28 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1744 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:13:28.702254 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-34e4eb9b-3123-4335-a9a6-5646de5b4c3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:28.702905 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-34e4eb9b-3123-4335-a9a6-5646de5b4c3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:28.708859 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34e4eb9b-3123-4335-a9a6-5646de5b4c3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:28.709520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34e4eb9b-3123-4335-a9a6-5646de5b4c3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:28.710045 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34e4eb9b-3123-4335-a9a6-5646de5b4c3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:28.710759 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34e4eb9b-3123-4335-a9a6-5646de5b4c3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:28.711224 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34e4eb9b-3123-4335-a9a6-5646de5b4c3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:28.711651 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34e4eb9b-3123-4335-a9a6-5646de5b4c3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:28.842364 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-34e4eb9b-3123-4335-a9a6-5646de5b4c3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:28.851487 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-34e4eb9b-3123-4335-a9a6-5646de5b4c3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1709 microversion: 2.1 time: 0.152998 Aug 30 01:13:28.852164 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 227/446] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:28 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:28.933263 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9964e08c-2eae-4c31-93b1-8927ecfab837 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:28.934216 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9964e08c-2eae-4c31-93b1-8927ecfab837 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:28.940518 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9964e08c-2eae-4c31-93b1-8927ecfab837 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:28.941134 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9964e08c-2eae-4c31-93b1-8927ecfab837 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:28.941620 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9964e08c-2eae-4c31-93b1-8927ecfab837 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:28.942342 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9964e08c-2eae-4c31-93b1-8927ecfab837 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:28.942802 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9964e08c-2eae-4c31-93b1-8927ecfab837 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:28.943228 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9964e08c-2eae-4c31-93b1-8927ecfab837 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:29.010032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9964e08c-2eae-4c31-93b1-8927ecfab837 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:29.017722 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9964e08c-2eae-4c31-93b1-8927ecfab837 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1298 microversion: 2.1 time: 0.089019 Aug 30 01:13:29.018316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 220/447] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:28 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:29.542042 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-7b270c45-fe2d-4115-bfe0-690c8fcb7587 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:29.542708 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-7b270c45-fe2d-4115-bfe0-690c8fcb7587 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:29.548939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b270c45-fe2d-4115-bfe0-690c8fcb7587 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:29.549429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b270c45-fe2d-4115-bfe0-690c8fcb7587 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:29.549898 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b270c45-fe2d-4115-bfe0-690c8fcb7587 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:29.550641 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b270c45-fe2d-4115-bfe0-690c8fcb7587 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:29.551245 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b270c45-fe2d-4115-bfe0-690c8fcb7587 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:29.551573 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7b270c45-fe2d-4115-bfe0-690c8fcb7587 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:29.598342 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1712188668", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "281ceb28-999a-45ac-8b94-e3a5aba703ca"}], "security_groups": [{"name": "tempest-securitygroup--621476077"}], "key_name": "tempest-keypair-2063945513", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:29.687257 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7b270c45-fe2d-4115-bfe0-690c8fcb7587 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:29.696535 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7b270c45-fe2d-4115-bfe0-690c8fcb7587 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:29.698142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7b270c45-fe2d-4115-bfe0-690c8fcb7587 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:29.699393 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-7b270c45-fe2d-4115-bfe0-690c8fcb7587 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1739 microversion: 2.20 time: 0.161475 Aug 30 01:13:29.699965 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 228/448] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:29 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:29.708852 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] validate_networks() for [('281ceb28-999a-45ac-8b94-e3a5aba703ca', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:13:29.872326 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-970fb2b3-4017-425d-91dd-2680336b3bd8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:29.872922 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-970fb2b3-4017-425d-91dd-2680336b3bd8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:29.879869 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-970fb2b3-4017-425d-91dd-2680336b3bd8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:29.880347 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-970fb2b3-4017-425d-91dd-2680336b3bd8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:29.880773 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-970fb2b3-4017-425d-91dd-2680336b3bd8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:29.881467 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-970fb2b3-4017-425d-91dd-2680336b3bd8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:29.881949 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-970fb2b3-4017-425d-91dd-2680336b3bd8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:29.882369 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-970fb2b3-4017-425d-91dd-2680336b3bd8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:30.012578 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-970fb2b3-4017-425d-91dd-2680336b3bd8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:30.021338 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-970fb2b3-4017-425d-91dd-2680336b3bd8 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1709 microversion: 2.1 time: 0.152749 Aug 30 01:13:30.021969 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 229/449] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:29 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:30.039266 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0561bdf0-d9fd-4705-88c2-dcc14ab4a77e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:30.039876 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0561bdf0-d9fd-4705-88c2-dcc14ab4a77e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:30.046572 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0561bdf0-d9fd-4705-88c2-dcc14ab4a77e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:30.047063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0561bdf0-d9fd-4705-88c2-dcc14ab4a77e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:30.047496 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0561bdf0-d9fd-4705-88c2-dcc14ab4a77e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:30.048195 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0561bdf0-d9fd-4705-88c2-dcc14ab4a77e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:30.048645 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0561bdf0-d9fd-4705-88c2-dcc14ab4a77e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:30.049069 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0561bdf0-d9fd-4705-88c2-dcc14ab4a77e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:30.097598 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:13:30.098327 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:13:30.102400 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:13:30.102400 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:13:30.102400 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:13:30.109563 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:30.110252 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:30.110673 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:30.111487 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:30.112092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:30.112592 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:30.116679 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0561bdf0-d9fd-4705-88c2-dcc14ab4a77e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:30.127585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0561bdf0-d9fd-4705-88c2-dcc14ab4a77e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1298 microversion: 2.1 time: 0.092133 Aug 30 01:13:30.128165 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 230/450] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:30 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:30.132109 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Getting quotas for project 11c8f48af7394a75ab6013ca066751a7. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:13:30.136775 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Getting quotas for user 942d175e7e2742728e66fea84c851038 and project 11c8f48af7394a75ab6013ca066751a7. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:13:30.149676 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:13:30.152075 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:13:30.288391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0c010b48-6245-4e6a-9dfd-61ce9d723398 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.693640 Aug 30 01:13:30.289477 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 221/451] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:13:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 01:13:30.300434 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d27e728b-8242-46a9-a7c1-06be5ceda3d6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:30.301882 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d27e728b-8242-46a9-a7c1-06be5ceda3d6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:30.355374 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d27e728b-8242-46a9-a7c1-06be5ceda3d6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:30.366416 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d27e728b-8242-46a9-a7c1-06be5ceda3d6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1242 microversion: 2.1 time: 0.070077 Aug 30 01:13:30.367486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 231/452] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:30 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:30.732181 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6f1bdac8-35c9-40cf-a8af-5268b42e6023 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:30.733422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6f1bdac8-35c9-40cf-a8af-5268b42e6023 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:30.744674 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f1bdac8-35c9-40cf-a8af-5268b42e6023 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:30.745418 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f1bdac8-35c9-40cf-a8af-5268b42e6023 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:30.746115 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f1bdac8-35c9-40cf-a8af-5268b42e6023 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:30.746843 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f1bdac8-35c9-40cf-a8af-5268b42e6023 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:30.747305 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f1bdac8-35c9-40cf-a8af-5268b42e6023 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:30.747744 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f1bdac8-35c9-40cf-a8af-5268b42e6023 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:30.888885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6f1bdac8-35c9-40cf-a8af-5268b42e6023 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:30.898070 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6f1bdac8-35c9-40cf-a8af-5268b42e6023 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:30.899626 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6f1bdac8-35c9-40cf-a8af-5268b42e6023 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:30.900776 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6f1bdac8-35c9-40cf-a8af-5268b42e6023 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1739 microversion: 2.20 time: 0.176521 Aug 30 01:13:30.901335 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 222/453] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:30 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:13:31.043692 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-bdcb3fa8-b461-4b27-b3b8-50b2d7a43c10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:31.044353 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-bdcb3fa8-b461-4b27-b3b8-50b2d7a43c10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:31.052077 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bdcb3fa8-b461-4b27-b3b8-50b2d7a43c10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:31.052558 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bdcb3fa8-b461-4b27-b3b8-50b2d7a43c10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:31.053119 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bdcb3fa8-b461-4b27-b3b8-50b2d7a43c10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:31.053842 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bdcb3fa8-b461-4b27-b3b8-50b2d7a43c10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:31.054301 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bdcb3fa8-b461-4b27-b3b8-50b2d7a43c10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:31.054745 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bdcb3fa8-b461-4b27-b3b8-50b2d7a43c10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:31.149287 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7ff0045b-3cd2-4565-96ba-70d9021bd7fc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:31.150074 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7ff0045b-3cd2-4565-96ba-70d9021bd7fc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:31.156306 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ff0045b-3cd2-4565-96ba-70d9021bd7fc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:31.156868 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ff0045b-3cd2-4565-96ba-70d9021bd7fc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:31.157407 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ff0045b-3cd2-4565-96ba-70d9021bd7fc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:31.158208 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ff0045b-3cd2-4565-96ba-70d9021bd7fc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:31.158760 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ff0045b-3cd2-4565-96ba-70d9021bd7fc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:31.159258 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ff0045b-3cd2-4565-96ba-70d9021bd7fc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:31.186280 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-bdcb3fa8-b461-4b27-b3b8-50b2d7a43c10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:31.195795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-bdcb3fa8-b461-4b27-b3b8-50b2d7a43c10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1709 microversion: 2.1 time: 0.155992 Aug 30 01:13:31.197706 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 232/454] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:31 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1709 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:31.248325 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7ff0045b-3cd2-4565-96ba-70d9021bd7fc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:31.258261 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7ff0045b-3cd2-4565-96ba-70d9021bd7fc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1298 microversion: 2.1 time: 0.113379 Aug 30 01:13:31.258873 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 223/455] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:31 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:31.387963 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a1450c78-f89b-4a9a-a6f7-788e14275dd0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:31.388734 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a1450c78-f89b-4a9a-a6f7-788e14275dd0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:31.390732 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:31.396478 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a1450c78-f89b-4a9a-a6f7-788e14275dd0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:31.396939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a1450c78-f89b-4a9a-a6f7-788e14275dd0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:31.397377 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a1450c78-f89b-4a9a-a6f7-788e14275dd0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:31.398122 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a1450c78-f89b-4a9a-a6f7-788e14275dd0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:31.399466 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a1450c78-f89b-4a9a-a6f7-788e14275dd0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:31.399905 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a1450c78-f89b-4a9a-a6f7-788e14275dd0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:31.464256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a1450c78-f89b-4a9a-a6f7-788e14275dd0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:31.476315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a1450c78-f89b-4a9a-a6f7-788e14275dd0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1246 microversion: 2.1 time: 0.092518 Aug 30 01:13:31.477180 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 233/456] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:31 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:31.925402 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-107cc4ce-39c5-41d8-81ca-f5b18678ea6c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:31.927318 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-107cc4ce-39c5-41d8-81ca-f5b18678ea6c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:31.934542 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-107cc4ce-39c5-41d8-81ca-f5b18678ea6c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:31.935253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-107cc4ce-39c5-41d8-81ca-f5b18678ea6c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:31.935835 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-107cc4ce-39c5-41d8-81ca-f5b18678ea6c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:31.936679 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-107cc4ce-39c5-41d8-81ca-f5b18678ea6c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:31.937290 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-107cc4ce-39c5-41d8-81ca-f5b18678ea6c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:31.937898 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-107cc4ce-39c5-41d8-81ca-f5b18678ea6c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:32.100113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-107cc4ce-39c5-41d8-81ca-f5b18678ea6c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:32.109804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-107cc4ce-39c5-41d8-81ca-f5b18678ea6c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:32.111718 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-107cc4ce-39c5-41d8-81ca-f5b18678ea6c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:32.113200 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-107cc4ce-39c5-41d8-81ca-f5b18678ea6c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1739 microversion: 2.20 time: 0.193087 Aug 30 01:13:32.114349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 224/457] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:31 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:32.220492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a39891ac-c99a-4d8b-a1ee-e37cd4fa04ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:32.221033 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a39891ac-c99a-4d8b-a1ee-e37cd4fa04ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:32.228598 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a39891ac-c99a-4d8b-a1ee-e37cd4fa04ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:32.229326 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a39891ac-c99a-4d8b-a1ee-e37cd4fa04ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:32.229962 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a39891ac-c99a-4d8b-a1ee-e37cd4fa04ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:32.230811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a39891ac-c99a-4d8b-a1ee-e37cd4fa04ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:32.231423 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a39891ac-c99a-4d8b-a1ee-e37cd4fa04ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:32.232044 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a39891ac-c99a-4d8b-a1ee-e37cd4fa04ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:32.268528 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:32.290831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e1922628-9134-470b-836f-e16f7dab6d49 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:32.292439 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e1922628-9134-470b-836f-e16f7dab6d49 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:32.301085 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e1922628-9134-470b-836f-e16f7dab6d49 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:32.302006 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e1922628-9134-470b-836f-e16f7dab6d49 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:32.302740 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e1922628-9134-470b-836f-e16f7dab6d49 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:32.303704 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e1922628-9134-470b-836f-e16f7dab6d49 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:32.304394 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e1922628-9134-470b-836f-e16f7dab6d49 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:32.305203 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e1922628-9134-470b-836f-e16f7dab6d49 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:32.443975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e1922628-9134-470b-836f-e16f7dab6d49 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:32.465095 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e1922628-9134-470b-836f-e16f7dab6d49 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1298 microversion: 2.1 time: 0.181941 Aug 30 01:13:32.477845 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 225/458] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:32 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1298 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:32.498898 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bbcb4466-2460-45bf-858a-5555addac15e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:32.499709 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bbcb4466-2460-45bf-858a-5555addac15e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:32.517892 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbcb4466-2460-45bf-858a-5555addac15e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:32.518403 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbcb4466-2460-45bf-858a-5555addac15e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:32.518839 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbcb4466-2460-45bf-858a-5555addac15e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:32.522117 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbcb4466-2460-45bf-858a-5555addac15e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:32.522674 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbcb4466-2460-45bf-858a-5555addac15e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:32.523551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbcb4466-2460-45bf-858a-5555addac15e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:32.544061 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a39891ac-c99a-4d8b-a1ee-e37cd4fa04ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:32.565345 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a39891ac-c99a-4d8b-a1ee-e37cd4fa04ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1709 microversion: 2.1 time: 0.348291 Aug 30 01:13:32.568218 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 234/459] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:32 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1709 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:32.632602 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bbcb4466-2460-45bf-858a-5555addac15e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:32.640678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bbcb4466-2460-45bf-858a-5555addac15e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1238 microversion: 2.1 time: 0.145559 Aug 30 01:13:32.641293 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 226/460] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:32 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1238 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:33.137752 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-818b0a36-34b9-4295-8418-7b38359e6058 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:33.139694 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-818b0a36-34b9-4295-8418-7b38359e6058 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:33.154389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-818b0a36-34b9-4295-8418-7b38359e6058 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:33.155842 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-818b0a36-34b9-4295-8418-7b38359e6058 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:33.156947 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-818b0a36-34b9-4295-8418-7b38359e6058 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:33.158499 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-818b0a36-34b9-4295-8418-7b38359e6058 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:33.161145 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-818b0a36-34b9-4295-8418-7b38359e6058 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:33.162378 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-818b0a36-34b9-4295-8418-7b38359e6058 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:33.473457 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-6e7fec36-59c6-455a-aa8a-11cb843471a8 req-af4ec8db-996a-4390-ba48-99fe87aa80a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4475905-983f-47fb-8b8e-6c87baeac22d", "name": "network-vif-plugged", "status": "completed", "tag": "3efaeb1f-3500-4863-b27f-c56c1aa2946c"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:33.493622 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-6e7fec36-59c6-455a-aa8a-11cb843471a8 req-af4ec8db-996a-4390-ba48-99fe87aa80a4 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:33.495988 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-6e7fec36-59c6-455a-aa8a-11cb843471a8 req-af4ec8db-996a-4390-ba48-99fe87aa80a4 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:33.496731 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-6e7fec36-59c6-455a-aa8a-11cb843471a8 req-af4ec8db-996a-4390-ba48-99fe87aa80a4 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:33.498287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-818b0a36-34b9-4295-8418-7b38359e6058 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:33.508892 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-818b0a36-34b9-4295-8418-7b38359e6058 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:33.516093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-818b0a36-34b9-4295-8418-7b38359e6058 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:33.517785 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-818b0a36-34b9-4295-8418-7b38359e6058 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1739 microversion: 2.20 time: 0.385135 Aug 30 01:13:33.518867 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 235/461] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:33 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1739 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:33.520330 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-6e7fec36-59c6-455a-aa8a-11cb843471a8 req-af4ec8db-996a-4390-ba48-99fe87aa80a4 service nova] Creating event network-vif-plugged:3efaeb1f-3500-4863-b27f-c56c1aa2946c for instance d4475905-983f-47fb-8b8e-6c87baeac22d on hv-cinder-81571 Aug 30 01:13:33.526294 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-6e7fec36-59c6-455a-aa8a-11cb843471a8 req-af4ec8db-996a-4390-ba48-99fe87aa80a4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059730 Aug 30 01:13:33.526920 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 227/462] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:13:33.536779 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-cd150db7-8501-4b4d-96b2-d75bb6182e52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:33.537577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-cd150db7-8501-4b4d-96b2-d75bb6182e52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:33.544790 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cd150db7-8501-4b4d-96b2-d75bb6182e52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:33.545277 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cd150db7-8501-4b4d-96b2-d75bb6182e52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:33.546237 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cd150db7-8501-4b4d-96b2-d75bb6182e52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:33.547189 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cd150db7-8501-4b4d-96b2-d75bb6182e52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:33.547792 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cd150db7-8501-4b4d-96b2-d75bb6182e52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:33.548561 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cd150db7-8501-4b4d-96b2-d75bb6182e52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:33.589676 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fbb335cb-d6bb-44bd-be46-760cbe5605f2 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:33.590820 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fbb335cb-d6bb-44bd-be46-760cbe5605f2 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:33.601497 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fbb335cb-d6bb-44bd-be46-760cbe5605f2 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:33.605127 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fbb335cb-d6bb-44bd-be46-760cbe5605f2 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:33.606594 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fbb335cb-d6bb-44bd-be46-760cbe5605f2 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:33.609033 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fbb335cb-d6bb-44bd-be46-760cbe5605f2 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:33.610677 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fbb335cb-d6bb-44bd-be46-760cbe5605f2 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:33.622416 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fbb335cb-d6bb-44bd-be46-760cbe5605f2 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:33.624983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-cd150db7-8501-4b4d-96b2-d75bb6182e52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:33.635749 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-cd150db7-8501-4b4d-96b2-d75bb6182e52 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1306 microversion: 2.1 time: 0.114247 Aug 30 01:13:33.636797 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 236/463] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:33 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1306 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:33.668688 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c4d4c69b-4600-419d-aba3-f1a709358d4b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:33.671712 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c4d4c69b-4600-419d-aba3-f1a709358d4b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:33.695840 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c4d4c69b-4600-419d-aba3-f1a709358d4b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:33.698106 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c4d4c69b-4600-419d-aba3-f1a709358d4b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:33.698789 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c4d4c69b-4600-419d-aba3-f1a709358d4b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:33.699695 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c4d4c69b-4600-419d-aba3-f1a709358d4b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:33.700703 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c4d4c69b-4600-419d-aba3-f1a709358d4b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:33.701149 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c4d4c69b-4600-419d-aba3-f1a709358d4b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:33.788126 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c4d4c69b-4600-419d-aba3-f1a709358d4b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:33.797209 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c4d4c69b-4600-419d-aba3-f1a709358d4b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1294 microversion: 2.1 time: 0.133241 Aug 30 01:13:33.801907 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 237/464] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:33 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1294 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:34.266181 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fbb335cb-d6bb-44bd-be46-760cbe5605f2 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:34.278124 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fbb335cb-d6bb-44bd-be46-760cbe5605f2 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1713 microversion: 2.1 time: 0.693768 Aug 30 01:13:34.278948 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 228/465] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:33 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1713 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:34.544146 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ae00db72-7e1a-4d39-9ecb-1a78ba440680 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:34.546045 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ae00db72-7e1a-4d39-9ecb-1a78ba440680 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:34.559353 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ae00db72-7e1a-4d39-9ecb-1a78ba440680 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:34.561123 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ae00db72-7e1a-4d39-9ecb-1a78ba440680 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:34.570278 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ae00db72-7e1a-4d39-9ecb-1a78ba440680 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:34.570278 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ae00db72-7e1a-4d39-9ecb-1a78ba440680 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:34.570278 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ae00db72-7e1a-4d39-9ecb-1a78ba440680 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:34.570278 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ae00db72-7e1a-4d39-9ecb-1a78ba440680 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:34.680113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d45746ae-62e8-47af-96e2-b7229226a32a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:34.680113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d45746ae-62e8-47af-96e2-b7229226a32a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:34.680113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d45746ae-62e8-47af-96e2-b7229226a32a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:34.680113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d45746ae-62e8-47af-96e2-b7229226a32a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:34.680814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d45746ae-62e8-47af-96e2-b7229226a32a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:34.690656 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d45746ae-62e8-47af-96e2-b7229226a32a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:34.691280 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d45746ae-62e8-47af-96e2-b7229226a32a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:34.691783 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d45746ae-62e8-47af-96e2-b7229226a32a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:34.865473 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ae00db72-7e1a-4d39-9ecb-1a78ba440680 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:34.875219 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ae00db72-7e1a-4d39-9ecb-1a78ba440680 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:34.877968 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ae00db72-7e1a-4d39-9ecb-1a78ba440680 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:34.878198 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ae00db72-7e1a-4d39-9ecb-1a78ba440680 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1739 microversion: 2.20 time: 0.337884 Aug 30 01:13:34.884127 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 238/466] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:34 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1739 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:34.896492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a2999598-4bba-4538-8c29-7cafd3055b5d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:34.898244 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a2999598-4bba-4538-8c29-7cafd3055b5d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:34.912538 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2999598-4bba-4538-8c29-7cafd3055b5d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:34.913227 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2999598-4bba-4538-8c29-7cafd3055b5d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:34.914130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2999598-4bba-4538-8c29-7cafd3055b5d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:34.915096 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2999598-4bba-4538-8c29-7cafd3055b5d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:34.915775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2999598-4bba-4538-8c29-7cafd3055b5d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:34.916906 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2999598-4bba-4538-8c29-7cafd3055b5d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:34.919167 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d45746ae-62e8-47af-96e2-b7229226a32a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:34.928436 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d45746ae-62e8-47af-96e2-b7229226a32a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1304 microversion: 2.1 time: 0.272849 Aug 30 01:13:34.938871 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 229/467] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:34 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1304 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:35.012746 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a2999598-4bba-4538-8c29-7cafd3055b5d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:35.045024 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a2999598-4bba-4538-8c29-7cafd3055b5d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1302 microversion: 2.1 time: 0.159377 Aug 30 01:13:35.058609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 239/468] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:34 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1302 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:35.901966 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-871147fa-efbe-444d-84aa-107404869609 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:35.902448 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-871147fa-efbe-444d-84aa-107404869609 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:35.912756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-871147fa-efbe-444d-84aa-107404869609 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:35.913256 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-871147fa-efbe-444d-84aa-107404869609 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:35.913698 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-871147fa-efbe-444d-84aa-107404869609 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:35.914435 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-871147fa-efbe-444d-84aa-107404869609 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:35.914894 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-871147fa-efbe-444d-84aa-107404869609 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:35.915323 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-871147fa-efbe-444d-84aa-107404869609 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:35.920894 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:35.960247 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a599d6f8-4bde-40da-808a-7228438476e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:35.961019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a599d6f8-4bde-40da-808a-7228438476e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:35.967877 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a599d6f8-4bde-40da-808a-7228438476e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:35.970615 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a599d6f8-4bde-40da-808a-7228438476e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:35.970615 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a599d6f8-4bde-40da-808a-7228438476e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:35.970615 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a599d6f8-4bde-40da-808a-7228438476e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:35.970615 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a599d6f8-4bde-40da-808a-7228438476e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:35.971011 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a599d6f8-4bde-40da-808a-7228438476e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:36.136127 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a599d6f8-4bde-40da-808a-7228438476e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:36.147181 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a599d6f8-4bde-40da-808a-7228438476e6 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1371 microversion: 2.1 time: 0.191407 Aug 30 01:13:36.148357 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 240/469] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:35 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:36.155362 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e152314b-938b-41a3-9359-ca47d676295a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:36.156709 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e152314b-938b-41a3-9359-ca47d676295a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:36.165468 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e152314b-938b-41a3-9359-ca47d676295a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:36.166454 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e152314b-938b-41a3-9359-ca47d676295a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:36.166957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e152314b-938b-41a3-9359-ca47d676295a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:36.167922 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e152314b-938b-41a3-9359-ca47d676295a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:36.168439 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e152314b-938b-41a3-9359-ca47d676295a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:36.168940 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e152314b-938b-41a3-9359-ca47d676295a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:36.246540 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e152314b-938b-41a3-9359-ca47d676295a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:36.256835 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e152314b-938b-41a3-9359-ca47d676295a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1300 microversion: 2.1 time: 0.106925 Aug 30 01:13:36.258199 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 241/470] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:36 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:36.357704 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-871147fa-efbe-444d-84aa-107404869609 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:36.371235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-871147fa-efbe-444d-84aa-107404869609 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:36.373766 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-871147fa-efbe-444d-84aa-107404869609 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:36.376504 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-871147fa-efbe-444d-84aa-107404869609 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1739 microversion: 2.20 time: 0.477734 Aug 30 01:13:36.392301 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 230/471] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:35 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1739 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:37.168393 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ba445496-6e2b-4995-9e14-28b602b3c53a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:37.169008 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ba445496-6e2b-4995-9e14-28b602b3c53a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:37.171180 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=2 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:37.184808 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ba445496-6e2b-4995-9e14-28b602b3c53a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:37.184808 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ba445496-6e2b-4995-9e14-28b602b3c53a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:37.184808 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ba445496-6e2b-4995-9e14-28b602b3c53a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:37.189396 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ba445496-6e2b-4995-9e14-28b602b3c53a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:37.190226 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ba445496-6e2b-4995-9e14-28b602b3c53a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:37.190804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ba445496-6e2b-4995-9e14-28b602b3c53a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:37.288026 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a87348e7-705f-4100-a97e-dfb3ede89b9e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:37.288865 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a87348e7-705f-4100-a97e-dfb3ede89b9e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:37.310129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a87348e7-705f-4100-a97e-dfb3ede89b9e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:37.310773 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a87348e7-705f-4100-a97e-dfb3ede89b9e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:37.312889 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a87348e7-705f-4100-a97e-dfb3ede89b9e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:37.314448 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a87348e7-705f-4100-a97e-dfb3ede89b9e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:37.317947 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a87348e7-705f-4100-a97e-dfb3ede89b9e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:37.319101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a87348e7-705f-4100-a97e-dfb3ede89b9e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:37.487129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ba445496-6e2b-4995-9e14-28b602b3c53a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:37.505655 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ba445496-6e2b-4995-9e14-28b602b3c53a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1371 microversion: 2.1 time: 0.340852 Aug 30 01:13:37.506412 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 242/472] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:37 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1371 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:37.511648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ee08058c-4520-47ee-b3e7-22929e190843 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:37.512545 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ee08058c-4520-47ee-b3e7-22929e190843 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:37.519342 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee08058c-4520-47ee-b3e7-22929e190843 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:37.520851 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee08058c-4520-47ee-b3e7-22929e190843 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:37.521656 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee08058c-4520-47ee-b3e7-22929e190843 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:37.522663 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee08058c-4520-47ee-b3e7-22929e190843 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:37.523406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee08058c-4520-47ee-b3e7-22929e190843 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:37.527703 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee08058c-4520-47ee-b3e7-22929e190843 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:37.867736 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a87348e7-705f-4100-a97e-dfb3ede89b9e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:37.877693 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a87348e7-705f-4100-a97e-dfb3ede89b9e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1367 microversion: 2.1 time: 0.593565 Aug 30 01:13:37.880677 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 231/473] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:37 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1367 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:37.885674 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-e6245b96-4d27-4150-83ac-218206fb422d req-3940fc92-e974-40fc-91e1-f3d91aa3d7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc62a7d-bbdb-4131-b8bc-ab85635ad17d", "tag": "074c3418-a64e-4b71-96d8-7600e741330d"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:37.897315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ee08058c-4520-47ee-b3e7-22929e190843 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:37.899244 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e6245b96-4d27-4150-83ac-218206fb422d req-3940fc92-e974-40fc-91e1-f3d91aa3d7c1 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:37.899897 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e6245b96-4d27-4150-83ac-218206fb422d req-3940fc92-e974-40fc-91e1-f3d91aa3d7c1 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:37.900563 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e6245b96-4d27-4150-83ac-218206fb422d req-3940fc92-e974-40fc-91e1-f3d91aa3d7c1 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:37.916562 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ee08058c-4520-47ee-b3e7-22929e190843 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:37.919059 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-e6245b96-4d27-4150-83ac-218206fb422d req-3940fc92-e974-40fc-91e1-f3d91aa3d7c1 service nova] Creating event network-changed:074c3418-a64e-4b71-96d8-7600e741330d for instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d on hv-cinder-81571 Aug 30 01:13:37.936398 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ee08058c-4520-47ee-b3e7-22929e190843 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:37.940493 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ee08058c-4520-47ee-b3e7-22929e190843 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1739 microversion: 2.20 time: 0.432449 Aug 30 01:13:37.943994 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 243/474] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:37 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1739 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:37.945439 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-e6245b96-4d27-4150-83ac-218206fb422d req-3940fc92-e974-40fc-91e1-f3d91aa3d7c1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061787 Aug 30 01:13:37.949846 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 232/475] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:13:38.527460 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-44576306-43c4-4e22-8d81-f577c8714c6f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:38.529260 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-44576306-43c4-4e22-8d81-f577c8714c6f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:38.540312 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-44576306-43c4-4e22-8d81-f577c8714c6f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:38.540801 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-44576306-43c4-4e22-8d81-f577c8714c6f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:38.541259 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-44576306-43c4-4e22-8d81-f577c8714c6f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:38.542970 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-44576306-43c4-4e22-8d81-f577c8714c6f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:38.543384 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-44576306-43c4-4e22-8d81-f577c8714c6f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:38.543808 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-44576306-43c4-4e22-8d81-f577c8714c6f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:38.768675 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-44576306-43c4-4e22-8d81-f577c8714c6f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:38.782897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-44576306-43c4-4e22-8d81-f577c8714c6f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1371 microversion: 2.1 time: 0.259741 Aug 30 01:13:38.783808 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 244/476] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:38 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:38.902160 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dbfc25de-71de-409e-a65c-f28b9c94dbfa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:38.903572 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dbfc25de-71de-409e-a65c-f28b9c94dbfa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:38.915734 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbfc25de-71de-409e-a65c-f28b9c94dbfa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:38.916324 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbfc25de-71de-409e-a65c-f28b9c94dbfa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:38.916885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbfc25de-71de-409e-a65c-f28b9c94dbfa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:38.917658 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbfc25de-71de-409e-a65c-f28b9c94dbfa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:38.918586 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbfc25de-71de-409e-a65c-f28b9c94dbfa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:38.919117 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbfc25de-71de-409e-a65c-f28b9c94dbfa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:38.970600 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-1091d6e1-50a5-4e38-a761-bbbcedf9e5bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:38.973168 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-1091d6e1-50a5-4e38-a761-bbbcedf9e5bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:38.986565 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1091d6e1-50a5-4e38-a761-bbbcedf9e5bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:38.987578 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1091d6e1-50a5-4e38-a761-bbbcedf9e5bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:38.988994 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1091d6e1-50a5-4e38-a761-bbbcedf9e5bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:38.989987 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1091d6e1-50a5-4e38-a761-bbbcedf9e5bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:38.990854 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1091d6e1-50a5-4e38-a761-bbbcedf9e5bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:38.991437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1091d6e1-50a5-4e38-a761-bbbcedf9e5bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:39.132131 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dbfc25de-71de-409e-a65c-f28b9c94dbfa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:39.144622 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dbfc25de-71de-409e-a65c-f28b9c94dbfa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1367 microversion: 2.1 time: 0.245815 Aug 30 01:13:39.160096 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 233/477] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:38 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:39.222764 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-1091d6e1-50a5-4e38-a761-bbbcedf9e5bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:39.236906 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-1091d6e1-50a5-4e38-a761-bbbcedf9e5bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:39.236906 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-1091d6e1-50a5-4e38-a761-bbbcedf9e5bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:39.236906 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-1091d6e1-50a5-4e38-a761-bbbcedf9e5bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1739 microversion: 2.20 time: 0.269378 Aug 30 01:13:39.237227 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 245/478] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:38 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:13:39.803875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-33e6fd41-105d-4e0d-b0d9-8652cc56d090 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:39.804477 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-33e6fd41-105d-4e0d-b0d9-8652cc56d090 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:39.810742 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33e6fd41-105d-4e0d-b0d9-8652cc56d090 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:39.811234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33e6fd41-105d-4e0d-b0d9-8652cc56d090 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:39.817988 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33e6fd41-105d-4e0d-b0d9-8652cc56d090 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:39.817988 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33e6fd41-105d-4e0d-b0d9-8652cc56d090 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:39.817988 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33e6fd41-105d-4e0d-b0d9-8652cc56d090 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:39.817988 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33e6fd41-105d-4e0d-b0d9-8652cc56d090 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:40.121288 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:40.145205 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=12 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:40.171905 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-3b2bdfe4-7ec2-4044-b3a5-82d422bc4d0e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:40.172667 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-3b2bdfe4-7ec2-4044-b3a5-82d422bc4d0e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:40.179501 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3b2bdfe4-7ec2-4044-b3a5-82d422bc4d0e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:40.180272 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3b2bdfe4-7ec2-4044-b3a5-82d422bc4d0e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:40.180715 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3b2bdfe4-7ec2-4044-b3a5-82d422bc4d0e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:40.181422 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3b2bdfe4-7ec2-4044-b3a5-82d422bc4d0e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:40.181958 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3b2bdfe4-7ec2-4044-b3a5-82d422bc4d0e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:40.182390 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3b2bdfe4-7ec2-4044-b3a5-82d422bc4d0e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:40.334994 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-3b2bdfe4-7ec2-4044-b3a5-82d422bc4d0e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:40.343538 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-3b2bdfe4-7ec2-4044-b3a5-82d422bc4d0e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1367 microversion: 2.1 time: 0.176007 Aug 30 01:13:40.347423 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 246/479] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:40 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:40.349406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-89f0633c-c790-40b7-93be-e56d86c4b9fb req-dda9ffd5-779e-4e8f-ad03-bf0699d8d6cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8307f2-8199-4ffe-aa65-ab56d819f4a1", "tag": "2d5417df-fe2d-408c-83bc-53e948b0ec1f"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:40.359432 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-89f0633c-c790-40b7-93be-e56d86c4b9fb req-dda9ffd5-779e-4e8f-ad03-bf0699d8d6cd service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:40.359929 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-89f0633c-c790-40b7-93be-e56d86c4b9fb req-dda9ffd5-779e-4e8f-ad03-bf0699d8d6cd service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:40.360327 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-89f0633c-c790-40b7-93be-e56d86c4b9fb req-dda9ffd5-779e-4e8f-ad03-bf0699d8d6cd service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:40.363227 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=12 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:40.373007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-89f0633c-c790-40b7-93be-e56d86c4b9fb req-dda9ffd5-779e-4e8f-ad03-bf0699d8d6cd service nova] Creating event network-changed:2d5417df-fe2d-408c-83bc-53e948b0ec1f for instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 on hv-cinder-81571 Aug 30 01:13:40.378280 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-89f0633c-c790-40b7-93be-e56d86c4b9fb req-dda9ffd5-779e-4e8f-ad03-bf0699d8d6cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032697 Aug 30 01:13:40.381957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 247/480] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:13:40.384388 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5eb1b435-777c-4495-af65-af062dadc3fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:40.385071 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5eb1b435-777c-4495-af65-af062dadc3fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:40.391893 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5eb1b435-777c-4495-af65-af062dadc3fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:40.392788 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5eb1b435-777c-4495-af65-af062dadc3fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:40.392788 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5eb1b435-777c-4495-af65-af062dadc3fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:40.393476 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5eb1b435-777c-4495-af65-af062dadc3fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:40.393994 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5eb1b435-777c-4495-af65-af062dadc3fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:40.395040 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5eb1b435-777c-4495-af65-af062dadc3fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:40.408976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-33e6fd41-105d-4e0d-b0d9-8652cc56d090 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:40.434011 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-33e6fd41-105d-4e0d-b0d9-8652cc56d090 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1371 microversion: 2.1 time: 0.633863 Aug 30 01:13:40.435637 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 234/481] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:39 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1371 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:40.634136 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5eb1b435-777c-4495-af65-af062dadc3fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:40.646897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5eb1b435-777c-4495-af65-af062dadc3fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:40.648744 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5eb1b435-777c-4495-af65-af062dadc3fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:40.650195 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5eb1b435-777c-4495-af65-af062dadc3fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1739 microversion: 2.20 time: 0.269612 Aug 30 01:13:40.655934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 248/482] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:40 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:41.370467 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b46983d7-0d61-42c6-8d9f-cd76381f0e26 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:41.371891 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b46983d7-0d61-42c6-8d9f-cd76381f0e26 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:41.382640 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b46983d7-0d61-42c6-8d9f-cd76381f0e26 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:41.383359 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b46983d7-0d61-42c6-8d9f-cd76381f0e26 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:41.383789 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b46983d7-0d61-42c6-8d9f-cd76381f0e26 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:41.384671 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b46983d7-0d61-42c6-8d9f-cd76381f0e26 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:41.385148 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b46983d7-0d61-42c6-8d9f-cd76381f0e26 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:41.385602 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b46983d7-0d61-42c6-8d9f-cd76381f0e26 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:41.462278 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c19ff90f-ad74-4347-9350-c58b0c2c3a7d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:41.462892 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c19ff90f-ad74-4347-9350-c58b0c2c3a7d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:41.480726 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c19ff90f-ad74-4347-9350-c58b0c2c3a7d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:41.481493 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c19ff90f-ad74-4347-9350-c58b0c2c3a7d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:41.482117 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c19ff90f-ad74-4347-9350-c58b0c2c3a7d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:41.485387 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c19ff90f-ad74-4347-9350-c58b0c2c3a7d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:41.486092 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c19ff90f-ad74-4347-9350-c58b0c2c3a7d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:41.486675 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c19ff90f-ad74-4347-9350-c58b0c2c3a7d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:41.668709 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b46983d7-0d61-42c6-8d9f-cd76381f0e26 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:41.686029 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b46983d7-0d61-42c6-8d9f-cd76381f0e26 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1367 microversion: 2.1 time: 0.322286 Aug 30 01:13:41.701122 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 235/483] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:41 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:41.701122 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8bd2ea30-0c5b-46c3-a0d3-937b68d85970 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:41.701122 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8bd2ea30-0c5b-46c3-a0d3-937b68d85970 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:41.709308 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8bd2ea30-0c5b-46c3-a0d3-937b68d85970 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:41.710225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8bd2ea30-0c5b-46c3-a0d3-937b68d85970 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:41.710872 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8bd2ea30-0c5b-46c3-a0d3-937b68d85970 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:41.711813 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8bd2ea30-0c5b-46c3-a0d3-937b68d85970 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:41.712487 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8bd2ea30-0c5b-46c3-a0d3-937b68d85970 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:41.713118 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8bd2ea30-0c5b-46c3-a0d3-937b68d85970 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:41.768542 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c19ff90f-ad74-4347-9350-c58b0c2c3a7d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:41.807458 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c19ff90f-ad74-4347-9350-c58b0c2c3a7d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1371 microversion: 2.1 time: 0.350803 Aug 30 01:13:41.810453 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 249/484] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:41 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1371 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:41.907848 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8bd2ea30-0c5b-46c3-a0d3-937b68d85970 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:41.918479 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8bd2ea30-0c5b-46c3-a0d3-937b68d85970 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:41.920648 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8bd2ea30-0c5b-46c3-a0d3-937b68d85970 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:41.922015 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8bd2ea30-0c5b-46c3-a0d3-937b68d85970 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1739 microversion: 2.20 time: 0.232313 Aug 30 01:13:41.922731 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 236/485] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:41 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:42.709395 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9604c123-d20c-4b75-a74c-05ef03f8a0b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:42.710494 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9604c123-d20c-4b75-a74c-05ef03f8a0b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:42.718829 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9604c123-d20c-4b75-a74c-05ef03f8a0b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:42.719325 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9604c123-d20c-4b75-a74c-05ef03f8a0b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:42.719760 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9604c123-d20c-4b75-a74c-05ef03f8a0b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:42.720543 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9604c123-d20c-4b75-a74c-05ef03f8a0b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:42.720990 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9604c123-d20c-4b75-a74c-05ef03f8a0b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:42.721427 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9604c123-d20c-4b75-a74c-05ef03f8a0b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:42.831144 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ce53cfe4-b009-4fc5-8795-bf8ede00c7b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:42.832658 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ce53cfe4-b009-4fc5-8795-bf8ede00c7b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:42.850779 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce53cfe4-b009-4fc5-8795-bf8ede00c7b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:42.851288 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce53cfe4-b009-4fc5-8795-bf8ede00c7b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:42.851739 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce53cfe4-b009-4fc5-8795-bf8ede00c7b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:42.852472 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce53cfe4-b009-4fc5-8795-bf8ede00c7b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:42.852942 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce53cfe4-b009-4fc5-8795-bf8ede00c7b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:42.853534 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce53cfe4-b009-4fc5-8795-bf8ede00c7b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:42.980434 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9604c123-d20c-4b75-a74c-05ef03f8a0b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:42.988852 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9604c123-d20c-4b75-a74c-05ef03f8a0b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1367 microversion: 2.1 time: 0.284125 Aug 30 01:13:42.989426 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 250/486] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:42 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:43.004720 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-171121bf-0949-4b12-af60-7fab3e6ffd9c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:43.005269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-171121bf-0949-4b12-af60-7fab3e6ffd9c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:43.025751 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-171121bf-0949-4b12-af60-7fab3e6ffd9c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:43.026262 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-171121bf-0949-4b12-af60-7fab3e6ffd9c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:43.026697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-171121bf-0949-4b12-af60-7fab3e6ffd9c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:43.027399 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-171121bf-0949-4b12-af60-7fab3e6ffd9c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:43.027852 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-171121bf-0949-4b12-af60-7fab3e6ffd9c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:43.028274 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-171121bf-0949-4b12-af60-7fab3e6ffd9c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:43.079779 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ce53cfe4-b009-4fc5-8795-bf8ede00c7b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:43.095092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ce53cfe4-b009-4fc5-8795-bf8ede00c7b1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1371 microversion: 2.1 time: 0.269808 Aug 30 01:13:43.114132 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 237/487] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:42 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1371 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:43.402043 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-171121bf-0949-4b12-af60-7fab3e6ffd9c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:43.407639 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=100 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:43.434816 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-171121bf-0949-4b12-af60-7fab3e6ffd9c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:43.443194 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-171121bf-0949-4b12-af60-7fab3e6ffd9c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:43.457152 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-171121bf-0949-4b12-af60-7fab3e6ffd9c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1739 microversion: 2.20 time: 0.461245 Aug 30 01:13:43.457928 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 251/488] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:42 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1739 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:43.784393 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-081e7a63-839d-45ae-8670-270976717e4e req-d2c8efcd-57b9-4e4b-a975-ed16bd9ae80a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc62a7d-bbdb-4131-b8bc-ab85635ad17d", "name": "network-vif-plugged", "status": "completed", "tag": "074c3418-a64e-4b71-96d8-7600e741330d"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:43.817404 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-081e7a63-839d-45ae-8670-270976717e4e req-d2c8efcd-57b9-4e4b-a975-ed16bd9ae80a service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:43.819791 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-081e7a63-839d-45ae-8670-270976717e4e req-d2c8efcd-57b9-4e4b-a975-ed16bd9ae80a service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:43.821353 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-081e7a63-839d-45ae-8670-270976717e4e req-d2c8efcd-57b9-4e4b-a975-ed16bd9ae80a service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:43.842262 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-081e7a63-839d-45ae-8670-270976717e4e req-d2c8efcd-57b9-4e4b-a975-ed16bd9ae80a service nova] Creating event network-vif-plugged:074c3418-a64e-4b71-96d8-7600e741330d for instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d on hv-cinder-81571 Aug 30 01:13:43.849209 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-081e7a63-839d-45ae-8670-270976717e4e req-d2c8efcd-57b9-4e4b-a975-ed16bd9ae80a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069373 Aug 30 01:13:43.850258 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 238/489] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:13:44.013080 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-1cb6a547-aadf-4a95-8f58-e79ce9c3c379 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:44.014570 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-1cb6a547-aadf-4a95-8f58-e79ce9c3c379 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:44.024862 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1cb6a547-aadf-4a95-8f58-e79ce9c3c379 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:44.027917 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1cb6a547-aadf-4a95-8f58-e79ce9c3c379 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:44.027917 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1cb6a547-aadf-4a95-8f58-e79ce9c3c379 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:44.027917 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1cb6a547-aadf-4a95-8f58-e79ce9c3c379 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:44.027917 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1cb6a547-aadf-4a95-8f58-e79ce9c3c379 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:44.029424 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1cb6a547-aadf-4a95-8f58-e79ce9c3c379 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:44.125978 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d5aeb3fe-abe3-4745-9918-282e0c0d2f46 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:44.127100 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d5aeb3fe-abe3-4745-9918-282e0c0d2f46 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:44.147715 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d5aeb3fe-abe3-4745-9918-282e0c0d2f46 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:44.152325 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d5aeb3fe-abe3-4745-9918-282e0c0d2f46 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:44.154100 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d5aeb3fe-abe3-4745-9918-282e0c0d2f46 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:44.156951 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d5aeb3fe-abe3-4745-9918-282e0c0d2f46 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:44.159254 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d5aeb3fe-abe3-4745-9918-282e0c0d2f46 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:44.160768 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d5aeb3fe-abe3-4745-9918-282e0c0d2f46 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:44.318356 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-1cb6a547-aadf-4a95-8f58-e79ce9c3c379 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:44.335102 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-1cb6a547-aadf-4a95-8f58-e79ce9c3c379 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1367 microversion: 2.1 time: 0.326314 Aug 30 01:13:44.352321 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 252/490] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:44 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:44.519168 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ec2fe408-0d01-4420-9bc3-81f6f620afda tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:44.521239 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ec2fe408-0d01-4420-9bc3-81f6f620afda tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:44.528430 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec2fe408-0d01-4420-9bc3-81f6f620afda tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:44.529293 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec2fe408-0d01-4420-9bc3-81f6f620afda tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:44.529970 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec2fe408-0d01-4420-9bc3-81f6f620afda tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:44.531068 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec2fe408-0d01-4420-9bc3-81f6f620afda tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:44.531724 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec2fe408-0d01-4420-9bc3-81f6f620afda tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:44.532158 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ec2fe408-0d01-4420-9bc3-81f6f620afda tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:44.557137 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d5aeb3fe-abe3-4745-9918-282e0c0d2f46 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:44.557137 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d5aeb3fe-abe3-4745-9918-282e0c0d2f46 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1371 microversion: 2.1 time: 0.438076 Aug 30 01:13:44.559482 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 239/491] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:44 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1371 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:13:44.724342 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ec2fe408-0d01-4420-9bc3-81f6f620afda tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:44.732539 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ec2fe408-0d01-4420-9bc3-81f6f620afda tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:44.734014 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ec2fe408-0d01-4420-9bc3-81f6f620afda tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:44.735176 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ec2fe408-0d01-4420-9bc3-81f6f620afda tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1739 microversion: 2.20 time: 0.236730 Aug 30 01:13:44.735737 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 253/492] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:44 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:13:45.357011 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-075b1275-1bd6-4482-ab65-7affc971f64b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:45.358097 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-075b1275-1bd6-4482-ab65-7affc971f64b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:45.364187 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-075b1275-1bd6-4482-ab65-7affc971f64b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:45.364678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-075b1275-1bd6-4482-ab65-7affc971f64b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:45.365111 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-075b1275-1bd6-4482-ab65-7affc971f64b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:45.365974 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-075b1275-1bd6-4482-ab65-7affc971f64b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:45.366433 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-075b1275-1bd6-4482-ab65-7affc971f64b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:45.366856 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-075b1275-1bd6-4482-ab65-7affc971f64b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:45.526669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-075b1275-1bd6-4482-ab65-7affc971f64b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:45.535820 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-075b1275-1bd6-4482-ab65-7affc971f64b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1367 microversion: 2.1 time: 0.182529 Aug 30 01:13:45.537808 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 240/493] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:45 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:45.580982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9f268845-a3e5-4685-b718-d5a2a5344f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:45.583592 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9f268845-a3e5-4685-b718-d5a2a5344f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:45.592139 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9f268845-a3e5-4685-b718-d5a2a5344f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:45.593044 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9f268845-a3e5-4685-b718-d5a2a5344f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:45.593659 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9f268845-a3e5-4685-b718-d5a2a5344f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:45.594819 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9f268845-a3e5-4685-b718-d5a2a5344f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:45.595489 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9f268845-a3e5-4685-b718-d5a2a5344f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:45.598348 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9f268845-a3e5-4685-b718-d5a2a5344f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:45.764003 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4bfd1b93-5376-48db-af35-83a27717bb9f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:45.764869 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4bfd1b93-5376-48db-af35-83a27717bb9f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:45.772775 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4bfd1b93-5376-48db-af35-83a27717bb9f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:45.773632 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4bfd1b93-5376-48db-af35-83a27717bb9f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:45.774235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4bfd1b93-5376-48db-af35-83a27717bb9f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:45.775085 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4bfd1b93-5376-48db-af35-83a27717bb9f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:45.775688 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4bfd1b93-5376-48db-af35-83a27717bb9f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:45.776258 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4bfd1b93-5376-48db-af35-83a27717bb9f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:45.829045 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9f268845-a3e5-4685-b718-d5a2a5344f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:45.845093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9f268845-a3e5-4685-b718-d5a2a5344f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1371 microversion: 2.1 time: 0.267843 Aug 30 01:13:45.861909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 254/494] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:45 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:45.866738 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-a74bf1bd-100d-4699-9db7-f18e2766fb11 req-2d32143a-23c4-4285-9d53-546a06c86711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8307f2-8199-4ffe-aa65-ab56d819f4a1", "name": "network-vif-plugged", "status": "completed", "tag": "2d5417df-fe2d-408c-83bc-53e948b0ec1f"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:45.883415 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-a74bf1bd-100d-4699-9db7-f18e2766fb11 req-2d32143a-23c4-4285-9d53-546a06c86711 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:45.883897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-a74bf1bd-100d-4699-9db7-f18e2766fb11 req-2d32143a-23c4-4285-9d53-546a06c86711 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:45.884812 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-a74bf1bd-100d-4699-9db7-f18e2766fb11 req-2d32143a-23c4-4285-9d53-546a06c86711 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:45.942351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-a74bf1bd-100d-4699-9db7-f18e2766fb11 req-2d32143a-23c4-4285-9d53-546a06c86711 service nova] Creating event network-vif-plugged:2d5417df-fe2d-408c-83bc-53e948b0ec1f for instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 on hv-cinder-81571 Aug 30 01:13:45.958126 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-a74bf1bd-100d-4699-9db7-f18e2766fb11 req-2d32143a-23c4-4285-9d53-546a06c86711 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094669 Aug 30 01:13:45.959674 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 255/495] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:13:46.040871 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4bfd1b93-5376-48db-af35-83a27717bb9f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:46.049999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4bfd1b93-5376-48db-af35-83a27717bb9f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:46.052270 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4bfd1b93-5376-48db-af35-83a27717bb9f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:46.053451 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4bfd1b93-5376-48db-af35-83a27717bb9f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1739 microversion: 2.20 time: 0.299269 Aug 30 01:13:46.054538 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 241/496] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:45 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1739 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:13:46.558574 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6b1c37f6-771d-4175-a57b-cb43c19b61d8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:46.559314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6b1c37f6-771d-4175-a57b-cb43c19b61d8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:46.565484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6b1c37f6-771d-4175-a57b-cb43c19b61d8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:46.566611 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6b1c37f6-771d-4175-a57b-cb43c19b61d8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:46.567125 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6b1c37f6-771d-4175-a57b-cb43c19b61d8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:46.567814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6b1c37f6-771d-4175-a57b-cb43c19b61d8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:46.568295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6b1c37f6-771d-4175-a57b-cb43c19b61d8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:46.568700 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6b1c37f6-771d-4175-a57b-cb43c19b61d8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:46.746175 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6b1c37f6-771d-4175-a57b-cb43c19b61d8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:46.756004 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6b1c37f6-771d-4175-a57b-cb43c19b61d8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1367 microversion: 2.1 time: 0.201438 Aug 30 01:13:46.756688 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 256/497] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:46 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:46.868070 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6c210220-b277-4791-be25-93724d8620ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:46.868808 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6c210220-b277-4791-be25-93724d8620ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:46.876968 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c210220-b277-4791-be25-93724d8620ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:46.878780 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c210220-b277-4791-be25-93724d8620ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:46.879732 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c210220-b277-4791-be25-93724d8620ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:46.881060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c210220-b277-4791-be25-93724d8620ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:46.881752 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c210220-b277-4791-be25-93724d8620ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:46.882342 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c210220-b277-4791-be25-93724d8620ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:47.076810 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9b24d841-ee9e-4777-a11f-3eb83a4d882a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:47.078263 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9b24d841-ee9e-4777-a11f-3eb83a4d882a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:47.085075 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9b24d841-ee9e-4777-a11f-3eb83a4d882a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:47.086153 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9b24d841-ee9e-4777-a11f-3eb83a4d882a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:47.086715 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9b24d841-ee9e-4777-a11f-3eb83a4d882a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:47.087604 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9b24d841-ee9e-4777-a11f-3eb83a4d882a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:47.088154 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9b24d841-ee9e-4777-a11f-3eb83a4d882a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:47.088761 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9b24d841-ee9e-4777-a11f-3eb83a4d882a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:47.140543 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6c210220-b277-4791-be25-93724d8620ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:47.158725 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6c210220-b277-4791-be25-93724d8620ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1565 microversion: 2.1 time: 0.297118 Aug 30 01:13:47.159376 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 242/498] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:46 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1565 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:47.180514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ea16df03-6e00-4c02-a00c-80c826b4f64e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:47.180998 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ea16df03-6e00-4c02-a00c-80c826b4f64e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:47.187125 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea16df03-6e00-4c02-a00c-80c826b4f64e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:47.187618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea16df03-6e00-4c02-a00c-80c826b4f64e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:47.188129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea16df03-6e00-4c02-a00c-80c826b4f64e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:47.188783 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea16df03-6e00-4c02-a00c-80c826b4f64e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:47.189239 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea16df03-6e00-4c02-a00c-80c826b4f64e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:47.189670 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea16df03-6e00-4c02-a00c-80c826b4f64e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:47.244803 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9b24d841-ee9e-4777-a11f-3eb83a4d882a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:47.255997 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9b24d841-ee9e-4777-a11f-3eb83a4d882a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:47.263750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9b24d841-ee9e-4777-a11f-3eb83a4d882a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:47.263750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9b24d841-ee9e-4777-a11f-3eb83a4d882a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1739 microversion: 2.20 time: 0.186670 Aug 30 01:13:47.263750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 257/499] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:47 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:13:47.327095 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ea16df03-6e00-4c02-a00c-80c826b4f64e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150799 Aug 30 01:13:47.332291 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 243/500] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 30 01:13:47 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:13:47.778057 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-3b33faba-5e0a-4e96-892a-75239da42330 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:47.779225 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-3b33faba-5e0a-4e96-892a-75239da42330 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:47.786650 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3b33faba-5e0a-4e96-892a-75239da42330 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:47.787481 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3b33faba-5e0a-4e96-892a-75239da42330 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:47.788130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3b33faba-5e0a-4e96-892a-75239da42330 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:47.789068 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3b33faba-5e0a-4e96-892a-75239da42330 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:47.789754 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3b33faba-5e0a-4e96-892a-75239da42330 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:47.790413 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3b33faba-5e0a-4e96-892a-75239da42330 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:47.955857 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-3b33faba-5e0a-4e96-892a-75239da42330 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:47.961623 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-3b33faba-5e0a-4e96-892a-75239da42330 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1367 microversion: 2.1 time: 0.187448 Aug 30 01:13:47.962593 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 258/501] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:47 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:48.282972 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d01b2a09-669d-41e1-841b-11afb14aef2c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:48.283577 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d01b2a09-669d-41e1-841b-11afb14aef2c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:48.289547 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d01b2a09-669d-41e1-841b-11afb14aef2c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:48.290361 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d01b2a09-669d-41e1-841b-11afb14aef2c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:48.291091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d01b2a09-669d-41e1-841b-11afb14aef2c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:48.291789 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d01b2a09-669d-41e1-841b-11afb14aef2c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:48.292247 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d01b2a09-669d-41e1-841b-11afb14aef2c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:48.292763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d01b2a09-669d-41e1-841b-11afb14aef2c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:48.445020 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d01b2a09-669d-41e1-841b-11afb14aef2c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:48.454128 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d01b2a09-669d-41e1-841b-11afb14aef2c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:48.459542 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d01b2a09-669d-41e1-841b-11afb14aef2c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:48.460952 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d01b2a09-669d-41e1-841b-11afb14aef2c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1721 microversion: 2.20 time: 0.182359 Aug 30 01:13:48.462155 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 244/502] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:48 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:48.488721 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-b0e4d3de-b0f4-44bf-8f02-e4cb17d9c784 req-15b163e2-9ab6-40f9-b981-5e1cb39ba1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc62a7d-bbdb-4131-b8bc-ab85635ad17d", "tag": "074c3418-a64e-4b71-96d8-7600e741330d"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:48.498704 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-b0e4d3de-b0f4-44bf-8f02-e4cb17d9c784 req-15b163e2-9ab6-40f9-b981-5e1cb39ba1b5 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:48.499192 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-b0e4d3de-b0f4-44bf-8f02-e4cb17d9c784 req-15b163e2-9ab6-40f9-b981-5e1cb39ba1b5 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:48.499773 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-b0e4d3de-b0f4-44bf-8f02-e4cb17d9c784 req-15b163e2-9ab6-40f9-b981-5e1cb39ba1b5 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:48.511433 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-b0e4d3de-b0f4-44bf-8f02-e4cb17d9c784 req-15b163e2-9ab6-40f9-b981-5e1cb39ba1b5 service nova] Creating event network-changed:074c3418-a64e-4b71-96d8-7600e741330d for instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d on hv-cinder-81571 Aug 30 01:13:48.516434 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-b0e4d3de-b0f4-44bf-8f02-e4cb17d9c784 req-15b163e2-9ab6-40f9-b981-5e1cb39ba1b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031684 Aug 30 01:13:48.517031 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 259/503] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:13:48.988621 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ed6c90cc-2259-4532-a211-9df48c2c8ecc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:48.988621 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ed6c90cc-2259-4532-a211-9df48c2c8ecc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:48.993033 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed6c90cc-2259-4532-a211-9df48c2c8ecc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:48.993519 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed6c90cc-2259-4532-a211-9df48c2c8ecc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:48.994265 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed6c90cc-2259-4532-a211-9df48c2c8ecc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:48.995776 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed6c90cc-2259-4532-a211-9df48c2c8ecc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:48.996169 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed6c90cc-2259-4532-a211-9df48c2c8ecc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:48.997209 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed6c90cc-2259-4532-a211-9df48c2c8ecc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:49.143050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ed6c90cc-2259-4532-a211-9df48c2c8ecc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:49.150930 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ed6c90cc-2259-4532-a211-9df48c2c8ecc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1367 microversion: 2.1 time: 0.171635 Aug 30 01:13:49.151541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 245/504] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:48 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:49.485499 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c2906543-7650-4941-a594-3794683dd423 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:49.486612 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c2906543-7650-4941-a594-3794683dd423 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:49.497761 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c2906543-7650-4941-a594-3794683dd423 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:49.498453 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c2906543-7650-4941-a594-3794683dd423 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:49.499362 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c2906543-7650-4941-a594-3794683dd423 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:49.499978 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c2906543-7650-4941-a594-3794683dd423 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:49.500433 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c2906543-7650-4941-a594-3794683dd423 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:49.500980 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c2906543-7650-4941-a594-3794683dd423 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:49.646744 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c2906543-7650-4941-a594-3794683dd423 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:49.656704 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c2906543-7650-4941-a594-3794683dd423 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:49.658680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c2906543-7650-4941-a594-3794683dd423 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:49.660867 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c2906543-7650-4941-a594-3794683dd423 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1721 microversion: 2.20 time: 0.179657 Aug 30 01:13:49.661842 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 260/505] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:49 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:50.173383 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ed7e8d5e-61a4-4210-84c6-e3a56a050a5a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:50.177763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ed7e8d5e-61a4-4210-84c6-e3a56a050a5a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:50.185013 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7e8d5e-61a4-4210-84c6-e3a56a050a5a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:50.186115 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7e8d5e-61a4-4210-84c6-e3a56a050a5a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:50.186115 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7e8d5e-61a4-4210-84c6-e3a56a050a5a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:50.187195 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7e8d5e-61a4-4210-84c6-e3a56a050a5a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:50.187876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7e8d5e-61a4-4210-84c6-e3a56a050a5a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:50.188380 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7e8d5e-61a4-4210-84c6-e3a56a050a5a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:50.508703 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ed7e8d5e-61a4-4210-84c6-e3a56a050a5a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:50.517772 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ed7e8d5e-61a4-4210-84c6-e3a56a050a5a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1557 microversion: 2.1 time: 0.348836 Aug 30 01:13:50.518599 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 246/506] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:13:50 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1557 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:13:50.539359 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6e152e06-686b-4bef-b81a-9482c8749f8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:50.539924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6e152e06-686b-4bef-b81a-9482c8749f8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:50.547086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6e152e06-686b-4bef-b81a-9482c8749f8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:50.547577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6e152e06-686b-4bef-b81a-9482c8749f8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:50.548014 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6e152e06-686b-4bef-b81a-9482c8749f8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:50.548880 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6e152e06-686b-4bef-b81a-9482c8749f8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:50.549340 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6e152e06-686b-4bef-b81a-9482c8749f8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:50.549920 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6e152e06-686b-4bef-b81a-9482c8749f8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:50.655141 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6e152e06-686b-4bef-b81a-9482c8749f8b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119595 Aug 30 01:13:50.655777 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 261/507] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 30 01:13:50 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:13:50.691894 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7d32edb5-0e39-4170-a83d-7279d7871875 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:50.693664 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7d32edb5-0e39-4170-a83d-7279d7871875 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:50.702241 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7d32edb5-0e39-4170-a83d-7279d7871875 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:50.703016 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7d32edb5-0e39-4170-a83d-7279d7871875 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:50.703796 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7d32edb5-0e39-4170-a83d-7279d7871875 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:50.704679 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7d32edb5-0e39-4170-a83d-7279d7871875 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:50.705289 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7d32edb5-0e39-4170-a83d-7279d7871875 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:50.706004 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7d32edb5-0e39-4170-a83d-7279d7871875 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:51.113161 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7d32edb5-0e39-4170-a83d-7279d7871875 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:51.125909 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7d32edb5-0e39-4170-a83d-7279d7871875 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:51.127635 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7d32edb5-0e39-4170-a83d-7279d7871875 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:51.129611 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7d32edb5-0e39-4170-a83d-7279d7871875 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1721 microversion: 2.20 time: 0.444038 Aug 30 01:13:51.131042 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 247/508] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:50 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1721 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:51.660839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-b9b5fd21-02f2-458c-a618-2bf020dbe31c req-051b6e96-845e-4911-8919-4ef41c72ec6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4475905-983f-47fb-8b8e-6c87baeac22d", "name": "network-vif-unplugged", "status": "completed", "tag": "3efaeb1f-3500-4863-b27f-c56c1aa2946c"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:51.679287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-b9b5fd21-02f2-458c-a618-2bf020dbe31c req-051b6e96-845e-4911-8919-4ef41c72ec6a service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:51.681814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-b9b5fd21-02f2-458c-a618-2bf020dbe31c req-051b6e96-845e-4911-8919-4ef41c72ec6a service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:51.683214 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-b9b5fd21-02f2-458c-a618-2bf020dbe31c req-051b6e96-845e-4911-8919-4ef41c72ec6a service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:51.700162 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-b9b5fd21-02f2-458c-a618-2bf020dbe31c req-051b6e96-845e-4911-8919-4ef41c72ec6a service nova] Creating event network-vif-unplugged:3efaeb1f-3500-4863-b27f-c56c1aa2946c for instance d4475905-983f-47fb-8b8e-6c87baeac22d on hv-cinder-81571 Aug 30 01:13:51.705165 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-b9b5fd21-02f2-458c-a618-2bf020dbe31c req-051b6e96-845e-4911-8919-4ef41c72ec6a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049192 Aug 30 01:13:51.705817 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 262/509] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:13:51.983558 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-6bd15241-4aec-4f19-b26d-31b93ef33d31 req-aff1997a-a788-496f-af0b-f9616a94924f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8307f2-8199-4ffe-aa65-ab56d819f4a1", "tag": "2d5417df-fe2d-408c-83bc-53e948b0ec1f"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:51.993862 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-6bd15241-4aec-4f19-b26d-31b93ef33d31 req-aff1997a-a788-496f-af0b-f9616a94924f service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:51.994353 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-6bd15241-4aec-4f19-b26d-31b93ef33d31 req-aff1997a-a788-496f-af0b-f9616a94924f service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:51.994789 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-6bd15241-4aec-4f19-b26d-31b93ef33d31 req-aff1997a-a788-496f-af0b-f9616a94924f service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:52.008479 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-6bd15241-4aec-4f19-b26d-31b93ef33d31 req-aff1997a-a788-496f-af0b-f9616a94924f service nova] Creating event network-changed:2d5417df-fe2d-408c-83bc-53e948b0ec1f for instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 on hv-cinder-81571 Aug 30 01:13:52.014319 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-6bd15241-4aec-4f19-b26d-31b93ef33d31 req-aff1997a-a788-496f-af0b-f9616a94924f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034361 Aug 30 01:13:52.014963 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 248/510] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:13:52.154562 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2ddd54ef-6991-4137-bcba-67efc1b5191f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:52.155545 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2ddd54ef-6991-4137-bcba-67efc1b5191f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:52.162695 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ddd54ef-6991-4137-bcba-67efc1b5191f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:52.163280 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ddd54ef-6991-4137-bcba-67efc1b5191f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:52.163827 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ddd54ef-6991-4137-bcba-67efc1b5191f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:52.164830 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ddd54ef-6991-4137-bcba-67efc1b5191f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:52.165410 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ddd54ef-6991-4137-bcba-67efc1b5191f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:52.165964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ddd54ef-6991-4137-bcba-67efc1b5191f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:52.313303 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2ddd54ef-6991-4137-bcba-67efc1b5191f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:52.323250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2ddd54ef-6991-4137-bcba-67efc1b5191f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:52.324763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2ddd54ef-6991-4137-bcba-67efc1b5191f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:52.326302 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2ddd54ef-6991-4137-bcba-67efc1b5191f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1721 microversion: 2.20 time: 0.176504 Aug 30 01:13:52.326941 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 263/511] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:52 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:53.350948 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-75a99f42-bf75-46cc-8b3a-1b69ec9a98a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:53.352806 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-75a99f42-bf75-46cc-8b3a-1b69ec9a98a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:53.361381 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75a99f42-bf75-46cc-8b3a-1b69ec9a98a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:53.362967 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75a99f42-bf75-46cc-8b3a-1b69ec9a98a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:53.363930 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75a99f42-bf75-46cc-8b3a-1b69ec9a98a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:53.365719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75a99f42-bf75-46cc-8b3a-1b69ec9a98a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:53.366713 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75a99f42-bf75-46cc-8b3a-1b69ec9a98a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:53.367468 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-75a99f42-bf75-46cc-8b3a-1b69ec9a98a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:53.373747 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:53.613431 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-75a99f42-bf75-46cc-8b3a-1b69ec9a98a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:53.622228 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-75a99f42-bf75-46cc-8b3a-1b69ec9a98a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:53.624120 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-75a99f42-bf75-46cc-8b3a-1b69ec9a98a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:53.625632 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-75a99f42-bf75-46cc-8b3a-1b69ec9a98a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1721 microversion: 2.20 time: 0.280410 Aug 30 01:13:53.639933 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 249/512] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:53 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:54.650172 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-fc5d93b9-e638-46a4-aa3e-750830246dfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:54.650951 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-fc5d93b9-e638-46a4-aa3e-750830246dfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:54.658778 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fc5d93b9-e638-46a4-aa3e-750830246dfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:54.659442 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fc5d93b9-e638-46a4-aa3e-750830246dfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:54.660378 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fc5d93b9-e638-46a4-aa3e-750830246dfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:54.661224 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fc5d93b9-e638-46a4-aa3e-750830246dfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:54.661871 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fc5d93b9-e638-46a4-aa3e-750830246dfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:54.662353 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fc5d93b9-e638-46a4-aa3e-750830246dfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:54.818142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-fc5d93b9-e638-46a4-aa3e-750830246dfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:54.826402 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-fc5d93b9-e638-46a4-aa3e-750830246dfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:54.827829 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-fc5d93b9-e638-46a4-aa3e-750830246dfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:54.828977 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-fc5d93b9-e638-46a4-aa3e-750830246dfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1724 microversion: 2.20 time: 0.183828 Aug 30 01:13:54.829535 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 264/513] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:54 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:54.853131 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d4da5de3-5234-457d-90f4-e1669358fdb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44a91d62-4c4f-41fd-9ae8-86e80546a880"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:54.855545 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d4da5de3-5234-457d-90f4-e1669358fdb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:54.861473 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4da5de3-5234-457d-90f4-e1669358fdb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:54.861999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4da5de3-5234-457d-90f4-e1669358fdb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:54.863231 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4da5de3-5234-457d-90f4-e1669358fdb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:54.864083 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4da5de3-5234-457d-90f4-e1669358fdb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:54.864544 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4da5de3-5234-457d-90f4-e1669358fdb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:54.864987 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4da5de3-5234-457d-90f4-e1669358fdb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:56.128772 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d4da5de3-5234-457d-90f4-e1669358fdb1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "POST /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.279020 Aug 30 01:13:56.129476 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 250/514] 10.222.0.52 () {62 vars in 1364 bytes} [Tue Aug 30 01:13:54 2022] POST /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/os-volume_attachments => generated 188 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:13:56.272259 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9bdf7e29-1668-4377-943d-0a733b4a0fbd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:13:56.272945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9bdf7e29-1668-4377-943d-0a733b4a0fbd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:56.279983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bdf7e29-1668-4377-943d-0a733b4a0fbd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:56.280476 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bdf7e29-1668-4377-943d-0a733b4a0fbd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:56.280915 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bdf7e29-1668-4377-943d-0a733b4a0fbd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:56.281617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bdf7e29-1668-4377-943d-0a733b4a0fbd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:56.282108 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bdf7e29-1668-4377-943d-0a733b4a0fbd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:56.282541 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9bdf7e29-1668-4377-943d-0a733b4a0fbd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:56.326888 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9bdf7e29-1668-4377-943d-0a733b4a0fbd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121233) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 01:13:56.664693 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9bdf7e29-1668-4377-943d-0a733b4a0fbd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "POST /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/action" status: 202 len: 0 microversion: 2.20 time: 0.396131 Aug 30 01:13:56.676435 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-687f5694-2975-4171-a69c-4764d6f15ff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:56.677133 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-687f5694-2975-4171-a69c-4764d6f15ff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:56.680267 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 265/515] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Aug 30 01:13:56 2022] POST /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:13:56.683670 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-687f5694-2975-4171-a69c-4764d6f15ff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:56.684684 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-687f5694-2975-4171-a69c-4764d6f15ff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:56.684684 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-687f5694-2975-4171-a69c-4764d6f15ff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:56.685387 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-687f5694-2975-4171-a69c-4764d6f15ff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:56.685880 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-687f5694-2975-4171-a69c-4764d6f15ff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:56.686315 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-687f5694-2975-4171-a69c-4764d6f15ff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:56.835023 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-687f5694-2975-4171-a69c-4764d6f15ff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:56.843707 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-687f5694-2975-4171-a69c-4764d6f15ff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:56.845145 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-687f5694-2975-4171-a69c-4764d6f15ff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:56.846330 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-687f5694-2975-4171-a69c-4764d6f15ff4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1750 microversion: 2.20 time: 0.175169 Aug 30 01:13:56.849158 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 251/516] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:56 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1750 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:57.873646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d3e322d7-e39d-46e0-88b4-ab0a94704c20 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:57.874404 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d3e322d7-e39d-46e0-88b4-ab0a94704c20 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:57.882105 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d3e322d7-e39d-46e0-88b4-ab0a94704c20 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:57.882597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d3e322d7-e39d-46e0-88b4-ab0a94704c20 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:57.883038 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d3e322d7-e39d-46e0-88b4-ab0a94704c20 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:57.883740 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d3e322d7-e39d-46e0-88b4-ab0a94704c20 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:57.884199 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d3e322d7-e39d-46e0-88b4-ab0a94704c20 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:57.884627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d3e322d7-e39d-46e0-88b4-ab0a94704c20 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:58.019827 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d3e322d7-e39d-46e0-88b4-ab0a94704c20 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:58.028535 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d3e322d7-e39d-46e0-88b4-ab0a94704c20 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:58.030044 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d3e322d7-e39d-46e0-88b4-ab0a94704c20 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:58.031200 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d3e322d7-e39d-46e0-88b4-ab0a94704c20 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1750 microversion: 2.20 time: 0.163004 Aug 30 01:13:58.031767 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 266/517] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:57 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:13:59.055843 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1bc1c402-6f93-464e-9c3c-481d2a8e56fc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:13:59.056459 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1bc1c402-6f93-464e-9c3c-481d2a8e56fc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:13:59.058426 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:13:59.063473 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1bc1c402-6f93-464e-9c3c-481d2a8e56fc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:59.064272 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1bc1c402-6f93-464e-9c3c-481d2a8e56fc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:59.064883 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1bc1c402-6f93-464e-9c3c-481d2a8e56fc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:59.066164 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1bc1c402-6f93-464e-9c3c-481d2a8e56fc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:13:59.066616 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1bc1c402-6f93-464e-9c3c-481d2a8e56fc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:13:59.067045 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1bc1c402-6f93-464e-9c3c-481d2a8e56fc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:13:59.210255 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1bc1c402-6f93-464e-9c3c-481d2a8e56fc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:59.221116 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1bc1c402-6f93-464e-9c3c-481d2a8e56fc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:59.222757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1bc1c402-6f93-464e-9c3c-481d2a8e56fc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:13:59.224167 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1bc1c402-6f93-464e-9c3c-481d2a8e56fc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1752 microversion: 2.20 time: 0.172497 Aug 30 01:13:59.225069 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 252/518] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:13:59 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:00.249508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-267af62a-96c0-49e0-ba32-cd754a713bb0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:00.250911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-267af62a-96c0-49e0-ba32-cd754a713bb0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:00.258150 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-267af62a-96c0-49e0-ba32-cd754a713bb0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:00.258641 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-267af62a-96c0-49e0-ba32-cd754a713bb0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:00.259081 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-267af62a-96c0-49e0-ba32-cd754a713bb0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:00.259797 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-267af62a-96c0-49e0-ba32-cd754a713bb0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:00.260257 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-267af62a-96c0-49e0-ba32-cd754a713bb0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:00.260684 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-267af62a-96c0-49e0-ba32-cd754a713bb0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:00.398959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-267af62a-96c0-49e0-ba32-cd754a713bb0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:00.410063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-267af62a-96c0-49e0-ba32-cd754a713bb0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:00.415421 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-267af62a-96c0-49e0-ba32-cd754a713bb0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:00.415421 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-267af62a-96c0-49e0-ba32-cd754a713bb0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1752 microversion: 2.20 time: 0.167315 Aug 30 01:14:00.415421 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 267/519] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:00 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:01.444622 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8305d83d-f5ef-42bf-92c1-a7494c59de9b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:01.449187 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8305d83d-f5ef-42bf-92c1-a7494c59de9b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:01.460279 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8305d83d-f5ef-42bf-92c1-a7494c59de9b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:01.460856 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8305d83d-f5ef-42bf-92c1-a7494c59de9b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:01.461357 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8305d83d-f5ef-42bf-92c1-a7494c59de9b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:01.462293 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8305d83d-f5ef-42bf-92c1-a7494c59de9b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:01.462877 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8305d83d-f5ef-42bf-92c1-a7494c59de9b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:01.463744 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8305d83d-f5ef-42bf-92c1-a7494c59de9b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:01.618730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8305d83d-f5ef-42bf-92c1-a7494c59de9b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:01.629542 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8305d83d-f5ef-42bf-92c1-a7494c59de9b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:01.632258 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8305d83d-f5ef-42bf-92c1-a7494c59de9b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:01.633432 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8305d83d-f5ef-42bf-92c1-a7494c59de9b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.200833 Aug 30 01:14:01.634009 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 253/520] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:01 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:02.656892 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-91fc42b8-8ac1-4d3c-8888-1616979a8c2f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:02.657625 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-91fc42b8-8ac1-4d3c-8888-1616979a8c2f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:02.660288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:02.665829 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91fc42b8-8ac1-4d3c-8888-1616979a8c2f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:02.666320 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91fc42b8-8ac1-4d3c-8888-1616979a8c2f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:02.666753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91fc42b8-8ac1-4d3c-8888-1616979a8c2f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:02.667449 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91fc42b8-8ac1-4d3c-8888-1616979a8c2f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:02.667903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91fc42b8-8ac1-4d3c-8888-1616979a8c2f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:02.668320 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91fc42b8-8ac1-4d3c-8888-1616979a8c2f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:02.805004 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-91fc42b8-8ac1-4d3c-8888-1616979a8c2f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:02.818525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-91fc42b8-8ac1-4d3c-8888-1616979a8c2f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:02.818525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-91fc42b8-8ac1-4d3c-8888-1616979a8c2f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:02.818525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-91fc42b8-8ac1-4d3c-8888-1616979a8c2f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.164309 Aug 30 01:14:02.818840 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 268/521] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:02 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:03.844957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bda2522f-b9e2-4696-933d-d7c2ab60de95 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:03.844957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bda2522f-b9e2-4696-933d-d7c2ab60de95 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:03.851631 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bda2522f-b9e2-4696-933d-d7c2ab60de95 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:03.851631 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bda2522f-b9e2-4696-933d-d7c2ab60de95 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:03.851631 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bda2522f-b9e2-4696-933d-d7c2ab60de95 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:03.851631 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bda2522f-b9e2-4696-933d-d7c2ab60de95 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:03.851947 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bda2522f-b9e2-4696-933d-d7c2ab60de95 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:03.851947 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bda2522f-b9e2-4696-933d-d7c2ab60de95 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:04.050375 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bda2522f-b9e2-4696-933d-d7c2ab60de95 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:04.060436 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bda2522f-b9e2-4696-933d-d7c2ab60de95 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:04.061876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bda2522f-b9e2-4696-933d-d7c2ab60de95 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:04.063042 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bda2522f-b9e2-4696-933d-d7c2ab60de95 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.226922 Aug 30 01:14:04.063745 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 254/522] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:03 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:05.087836 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2c04305b-4533-4cd2-a264-b354cb3c5bfd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:05.088447 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2c04305b-4533-4cd2-a264-b354cb3c5bfd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:05.096321 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2c04305b-4533-4cd2-a264-b354cb3c5bfd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:05.098466 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2c04305b-4533-4cd2-a264-b354cb3c5bfd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:05.099926 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2c04305b-4533-4cd2-a264-b354cb3c5bfd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:05.101153 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2c04305b-4533-4cd2-a264-b354cb3c5bfd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:05.101940 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2c04305b-4533-4cd2-a264-b354cb3c5bfd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:05.102645 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2c04305b-4533-4cd2-a264-b354cb3c5bfd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:05.283634 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2c04305b-4533-4cd2-a264-b354cb3c5bfd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:05.291299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:05.295412 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2c04305b-4533-4cd2-a264-b354cb3c5bfd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:05.296897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2c04305b-4533-4cd2-a264-b354cb3c5bfd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:05.298264 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2c04305b-4533-4cd2-a264-b354cb3c5bfd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.215897 Aug 30 01:14:05.299008 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 269/523] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:05 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:06.322631 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-83ae70f3-bdc3-45a2-97d6-0f4cb68fee50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:06.323966 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-83ae70f3-bdc3-45a2-97d6-0f4cb68fee50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:06.330332 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83ae70f3-bdc3-45a2-97d6-0f4cb68fee50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:06.330816 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83ae70f3-bdc3-45a2-97d6-0f4cb68fee50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:06.331282 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83ae70f3-bdc3-45a2-97d6-0f4cb68fee50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:06.331982 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83ae70f3-bdc3-45a2-97d6-0f4cb68fee50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:06.332460 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83ae70f3-bdc3-45a2-97d6-0f4cb68fee50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:06.333630 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-83ae70f3-bdc3-45a2-97d6-0f4cb68fee50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:06.529158 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-83ae70f3-bdc3-45a2-97d6-0f4cb68fee50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:06.543456 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-83ae70f3-bdc3-45a2-97d6-0f4cb68fee50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:06.545474 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-83ae70f3-bdc3-45a2-97d6-0f4cb68fee50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:06.546741 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-83ae70f3-bdc3-45a2-97d6-0f4cb68fee50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.228401 Aug 30 01:14:06.547812 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 255/524] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:06 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:07.570963 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0526a2ba-3ecb-482a-99b2-1fca18e78761 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:07.572230 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0526a2ba-3ecb-482a-99b2-1fca18e78761 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:07.580727 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0526a2ba-3ecb-482a-99b2-1fca18e78761 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:07.581493 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0526a2ba-3ecb-482a-99b2-1fca18e78761 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:07.582130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0526a2ba-3ecb-482a-99b2-1fca18e78761 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:07.584227 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0526a2ba-3ecb-482a-99b2-1fca18e78761 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:07.585175 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0526a2ba-3ecb-482a-99b2-1fca18e78761 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:07.585967 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0526a2ba-3ecb-482a-99b2-1fca18e78761 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:07.786808 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0526a2ba-3ecb-482a-99b2-1fca18e78761 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:07.803581 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0526a2ba-3ecb-482a-99b2-1fca18e78761 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:07.805024 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0526a2ba-3ecb-482a-99b2-1fca18e78761 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:07.810692 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0526a2ba-3ecb-482a-99b2-1fca18e78761 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.244276 Aug 30 01:14:07.827657 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 270/525] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:07 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:08.838445 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bd540025-af92-477d-ae2e-84d4eac29b74 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:08.843995 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bd540025-af92-477d-ae2e-84d4eac29b74 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:08.853270 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd540025-af92-477d-ae2e-84d4eac29b74 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:08.853842 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd540025-af92-477d-ae2e-84d4eac29b74 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:08.854362 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd540025-af92-477d-ae2e-84d4eac29b74 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:08.855257 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd540025-af92-477d-ae2e-84d4eac29b74 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:08.855785 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd540025-af92-477d-ae2e-84d4eac29b74 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:08.856317 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd540025-af92-477d-ae2e-84d4eac29b74 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:09.033443 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bd540025-af92-477d-ae2e-84d4eac29b74 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:09.043313 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bd540025-af92-477d-ae2e-84d4eac29b74 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:09.045332 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bd540025-af92-477d-ae2e-84d4eac29b74 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:09.046544 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bd540025-af92-477d-ae2e-84d4eac29b74 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.216585 Aug 30 01:14:09.047107 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 256/526] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:08 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:10.071725 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-02555f47-f8a8-4f82-bfd0-ccafb2a98463 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:10.072340 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-02555f47-f8a8-4f82-bfd0-ccafb2a98463 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:10.079161 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-02555f47-f8a8-4f82-bfd0-ccafb2a98463 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:10.079648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-02555f47-f8a8-4f82-bfd0-ccafb2a98463 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:10.080082 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-02555f47-f8a8-4f82-bfd0-ccafb2a98463 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:10.080777 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-02555f47-f8a8-4f82-bfd0-ccafb2a98463 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:10.081231 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-02555f47-f8a8-4f82-bfd0-ccafb2a98463 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:10.081661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-02555f47-f8a8-4f82-bfd0-ccafb2a98463 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:10.295197 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-02555f47-f8a8-4f82-bfd0-ccafb2a98463 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:10.315155 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-02555f47-f8a8-4f82-bfd0-ccafb2a98463 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:10.317022 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-02555f47-f8a8-4f82-bfd0-ccafb2a98463 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:10.319886 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-02555f47-f8a8-4f82-bfd0-ccafb2a98463 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.252732 Aug 30 01:14:10.320951 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 271/527] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:10 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:11.350125 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b0d67193-9632-4a67-89a1-d7cf5b45fcfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:11.350907 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b0d67193-9632-4a67-89a1-d7cf5b45fcfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:11.357228 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0d67193-9632-4a67-89a1-d7cf5b45fcfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:11.363255 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0d67193-9632-4a67-89a1-d7cf5b45fcfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:11.363255 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0d67193-9632-4a67-89a1-d7cf5b45fcfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:11.363255 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0d67193-9632-4a67-89a1-d7cf5b45fcfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:11.363255 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0d67193-9632-4a67-89a1-d7cf5b45fcfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:11.366927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0d67193-9632-4a67-89a1-d7cf5b45fcfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:11.518350 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b0d67193-9632-4a67-89a1-d7cf5b45fcfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:11.528916 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b0d67193-9632-4a67-89a1-d7cf5b45fcfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:11.530503 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b0d67193-9632-4a67-89a1-d7cf5b45fcfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:11.531724 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b0d67193-9632-4a67-89a1-d7cf5b45fcfb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.186394 Aug 30 01:14:11.532388 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 257/528] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:11 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:12.563620 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-27a585b7-1cd8-49d7-92f7-893c111638fb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:12.564424 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-27a585b7-1cd8-49d7-92f7-893c111638fb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:12.572682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27a585b7-1cd8-49d7-92f7-893c111638fb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:12.573337 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27a585b7-1cd8-49d7-92f7-893c111638fb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:12.573803 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27a585b7-1cd8-49d7-92f7-893c111638fb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:12.574846 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27a585b7-1cd8-49d7-92f7-893c111638fb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:12.575303 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27a585b7-1cd8-49d7-92f7-893c111638fb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:12.575726 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27a585b7-1cd8-49d7-92f7-893c111638fb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:12.747018 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-27a585b7-1cd8-49d7-92f7-893c111638fb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:12.757830 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-27a585b7-1cd8-49d7-92f7-893c111638fb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:12.759268 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-27a585b7-1cd8-49d7-92f7-893c111638fb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:12.760442 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-27a585b7-1cd8-49d7-92f7-893c111638fb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.207550 Aug 30 01:14:12.761004 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 272/529] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:12 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:13.784790 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d4c311db-14c3-4610-ad7f-9c43d2401b6a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:13.785414 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d4c311db-14c3-4610-ad7f-9c43d2401b6a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:13.792451 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4c311db-14c3-4610-ad7f-9c43d2401b6a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:13.794945 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4c311db-14c3-4610-ad7f-9c43d2401b6a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:13.794945 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4c311db-14c3-4610-ad7f-9c43d2401b6a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:13.794945 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4c311db-14c3-4610-ad7f-9c43d2401b6a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:13.794945 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4c311db-14c3-4610-ad7f-9c43d2401b6a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:13.795569 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4c311db-14c3-4610-ad7f-9c43d2401b6a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:13.933099 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d4c311db-14c3-4610-ad7f-9c43d2401b6a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:13.941858 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d4c311db-14c3-4610-ad7f-9c43d2401b6a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:13.943548 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d4c311db-14c3-4610-ad7f-9c43d2401b6a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:13.944744 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d4c311db-14c3-4610-ad7f-9c43d2401b6a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.163885 Aug 30 01:14:13.945536 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 258/530] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:13 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:14:14.969387 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e4478db2-c04b-45e0-9395-80960aebcb1b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:14.970045 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e4478db2-c04b-45e0-9395-80960aebcb1b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:14.976690 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e4478db2-c04b-45e0-9395-80960aebcb1b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:14.981964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e4478db2-c04b-45e0-9395-80960aebcb1b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:14.981964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e4478db2-c04b-45e0-9395-80960aebcb1b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:14.981964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e4478db2-c04b-45e0-9395-80960aebcb1b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:14.981964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e4478db2-c04b-45e0-9395-80960aebcb1b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:14.982318 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e4478db2-c04b-45e0-9395-80960aebcb1b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:15.119127 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e4478db2-c04b-45e0-9395-80960aebcb1b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:15.127999 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e4478db2-c04b-45e0-9395-80960aebcb1b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:15.129420 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e4478db2-c04b-45e0-9395-80960aebcb1b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:15.130630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e4478db2-c04b-45e0-9395-80960aebcb1b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.165304 Aug 30 01:14:15.131902 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 273/531] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:14 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:16.154335 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6177b7bd-0023-4ab0-b06e-ba6c9e30523b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:16.154941 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6177b7bd-0023-4ab0-b06e-ba6c9e30523b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:16.161148 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6177b7bd-0023-4ab0-b06e-ba6c9e30523b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:16.161629 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6177b7bd-0023-4ab0-b06e-ba6c9e30523b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:16.162105 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6177b7bd-0023-4ab0-b06e-ba6c9e30523b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:16.163744 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6177b7bd-0023-4ab0-b06e-ba6c9e30523b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:16.164254 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6177b7bd-0023-4ab0-b06e-ba6c9e30523b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:16.164680 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6177b7bd-0023-4ab0-b06e-ba6c9e30523b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:16.300426 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6177b7bd-0023-4ab0-b06e-ba6c9e30523b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:16.310682 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6177b7bd-0023-4ab0-b06e-ba6c9e30523b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:16.312119 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6177b7bd-0023-4ab0-b06e-ba6c9e30523b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:16.313295 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6177b7bd-0023-4ab0-b06e-ba6c9e30523b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.162815 Aug 30 01:14:16.313947 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 259/532] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:16 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:17.338372 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-fab08483-2e6c-4a3e-b4f8-e4b89458d6a6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:17.338984 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-fab08483-2e6c-4a3e-b4f8-e4b89458d6a6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:17.345592 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fab08483-2e6c-4a3e-b4f8-e4b89458d6a6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:17.346113 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fab08483-2e6c-4a3e-b4f8-e4b89458d6a6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:17.346552 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fab08483-2e6c-4a3e-b4f8-e4b89458d6a6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:17.347252 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fab08483-2e6c-4a3e-b4f8-e4b89458d6a6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:17.347707 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fab08483-2e6c-4a3e-b4f8-e4b89458d6a6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:17.348139 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fab08483-2e6c-4a3e-b4f8-e4b89458d6a6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:17.491646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-fab08483-2e6c-4a3e-b4f8-e4b89458d6a6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:17.500768 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-fab08483-2e6c-4a3e-b4f8-e4b89458d6a6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:17.502267 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-fab08483-2e6c-4a3e-b4f8-e4b89458d6a6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:17.503646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-fab08483-2e6c-4a3e-b4f8-e4b89458d6a6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.170562 Aug 30 01:14:17.504207 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 274/533] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:17 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:18.527607 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-767c7356-4d15-4f93-a2e4-f517550f44b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:18.528228 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-767c7356-4d15-4f93-a2e4-f517550f44b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:18.534596 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-767c7356-4d15-4f93-a2e4-f517550f44b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:18.535113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-767c7356-4d15-4f93-a2e4-f517550f44b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:18.535495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-767c7356-4d15-4f93-a2e4-f517550f44b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:18.540783 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-767c7356-4d15-4f93-a2e4-f517550f44b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:18.540783 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-767c7356-4d15-4f93-a2e4-f517550f44b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:18.540783 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-767c7356-4d15-4f93-a2e4-f517550f44b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:18.680039 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-767c7356-4d15-4f93-a2e4-f517550f44b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:18.693932 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-767c7356-4d15-4f93-a2e4-f517550f44b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:18.695445 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-767c7356-4d15-4f93-a2e4-f517550f44b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:18.696715 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-767c7356-4d15-4f93-a2e4-f517550f44b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.174108 Aug 30 01:14:18.697278 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 260/534] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:18 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:14:19.723618 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-49e53040-ec5b-42b5-87ad-bb0637fd107c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:19.724303 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-49e53040-ec5b-42b5-87ad-bb0637fd107c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:19.732050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-49e53040-ec5b-42b5-87ad-bb0637fd107c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:19.732534 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-49e53040-ec5b-42b5-87ad-bb0637fd107c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:19.733002 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-49e53040-ec5b-42b5-87ad-bb0637fd107c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:19.733697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-49e53040-ec5b-42b5-87ad-bb0637fd107c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:19.734187 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-49e53040-ec5b-42b5-87ad-bb0637fd107c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:19.734612 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-49e53040-ec5b-42b5-87ad-bb0637fd107c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:19.874277 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-49e53040-ec5b-42b5-87ad-bb0637fd107c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:19.884064 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-49e53040-ec5b-42b5-87ad-bb0637fd107c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:19.885495 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-49e53040-ec5b-42b5-87ad-bb0637fd107c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:19.886756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-49e53040-ec5b-42b5-87ad-bb0637fd107c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.169136 Aug 30 01:14:19.887325 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 275/535] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:19 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:20.910320 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-58755db1-12b3-4035-a111-c597b6e357bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:20.910861 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-58755db1-12b3-4035-a111-c597b6e357bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:20.916981 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58755db1-12b3-4035-a111-c597b6e357bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:20.917462 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58755db1-12b3-4035-a111-c597b6e357bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:20.917925 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58755db1-12b3-4035-a111-c597b6e357bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:20.918618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58755db1-12b3-4035-a111-c597b6e357bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:20.919068 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58755db1-12b3-4035-a111-c597b6e357bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:20.919755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58755db1-12b3-4035-a111-c597b6e357bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:21.056606 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-58755db1-12b3-4035-a111-c597b6e357bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:21.065596 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-58755db1-12b3-4035-a111-c597b6e357bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:21.067067 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-58755db1-12b3-4035-a111-c597b6e357bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:21.068218 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-58755db1-12b3-4035-a111-c597b6e357bb tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.161840 Aug 30 01:14:21.069547 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 261/536] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:20 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:22.092201 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-da9b930b-34b3-4e0e-8578-107901174f1a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:22.092936 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-da9b930b-34b3-4e0e-8578-107901174f1a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:22.099580 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da9b930b-34b3-4e0e-8578-107901174f1a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:22.100064 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da9b930b-34b3-4e0e-8578-107901174f1a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:22.100619 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da9b930b-34b3-4e0e-8578-107901174f1a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:22.101463 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da9b930b-34b3-4e0e-8578-107901174f1a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:22.101952 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da9b930b-34b3-4e0e-8578-107901174f1a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:22.102386 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da9b930b-34b3-4e0e-8578-107901174f1a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:22.239351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-da9b930b-34b3-4e0e-8578-107901174f1a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:22.251630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-da9b930b-34b3-4e0e-8578-107901174f1a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:22.251630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-da9b930b-34b3-4e0e-8578-107901174f1a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:22.251630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-da9b930b-34b3-4e0e-8578-107901174f1a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.162875 Aug 30 01:14:22.251906 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 276/537] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:22 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:23.274734 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7737b0b1-f1a7-4d54-a2ed-265bd985bc88 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:23.275514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7737b0b1-f1a7-4d54-a2ed-265bd985bc88 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:23.282337 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7737b0b1-f1a7-4d54-a2ed-265bd985bc88 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:23.282829 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7737b0b1-f1a7-4d54-a2ed-265bd985bc88 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:23.283271 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7737b0b1-f1a7-4d54-a2ed-265bd985bc88 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:23.283975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7737b0b1-f1a7-4d54-a2ed-265bd985bc88 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:23.284432 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7737b0b1-f1a7-4d54-a2ed-265bd985bc88 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:23.284863 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7737b0b1-f1a7-4d54-a2ed-265bd985bc88 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:23.296221 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-fd295587-cd3f-472a-9aed-91a4fd353b10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:23.296774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-fd295587-cd3f-472a-9aed-91a4fd353b10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:23.304798 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fd295587-cd3f-472a-9aed-91a4fd353b10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:23.305383 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fd295587-cd3f-472a-9aed-91a4fd353b10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:23.305988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fd295587-cd3f-472a-9aed-91a4fd353b10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:23.306828 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fd295587-cd3f-472a-9aed-91a4fd353b10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:23.307562 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fd295587-cd3f-472a-9aed-91a4fd353b10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:23.308063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fd295587-cd3f-472a-9aed-91a4fd353b10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:23.435709 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7737b0b1-f1a7-4d54-a2ed-265bd985bc88 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:23.446035 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7737b0b1-f1a7-4d54-a2ed-265bd985bc88 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:23.447583 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7737b0b1-f1a7-4d54-a2ed-265bd985bc88 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:23.448911 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7737b0b1-f1a7-4d54-a2ed-265bd985bc88 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.178281 Aug 30 01:14:23.449511 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 262/538] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:23 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:23.455684 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-fd295587-cd3f-472a-9aed-91a4fd353b10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lazy-loading 'services' on Instance uuid 5022a2c4-6b00-416c-9a13-63b0dec702b2 {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:14:23.700162 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-fd295587-cd3f-472a-9aed-91a4fd353b10 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/os-volume_attachments/32a160ed-a2a8-4376-8b17-b59bcab215b8" status: 202 len: 0 microversion: 2.1 time: 0.407868 Aug 30 01:14:23.700841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 277/539] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 30 01:14:23 2022] DELETE /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/os-volume_attachments/32a160ed-a2a8-4376-8b17-b59bcab215b8 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:14:24.476222 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-803b8101-3b8d-4d22-9af4-0284633ae93c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:24.476829 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-803b8101-3b8d-4d22-9af4-0284633ae93c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:24.483472 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-803b8101-3b8d-4d22-9af4-0284633ae93c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:24.483971 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-803b8101-3b8d-4d22-9af4-0284633ae93c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:24.484408 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-803b8101-3b8d-4d22-9af4-0284633ae93c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:24.485123 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-803b8101-3b8d-4d22-9af4-0284633ae93c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:24.485636 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-803b8101-3b8d-4d22-9af4-0284633ae93c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:24.486101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-803b8101-3b8d-4d22-9af4-0284633ae93c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:24.489504 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:24.641887 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-803b8101-3b8d-4d22-9af4-0284633ae93c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:24.652002 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-803b8101-3b8d-4d22-9af4-0284633ae93c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:24.653582 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-803b8101-3b8d-4d22-9af4-0284633ae93c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:24.656656 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-803b8101-3b8d-4d22-9af4-0284633ae93c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.182556 Aug 30 01:14:24.656656 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 263/540] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:24 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:25.679036 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2e806d64-356c-4e30-8b72-69782bcff0ce tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:25.679786 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2e806d64-356c-4e30-8b72-69782bcff0ce tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:25.686260 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e806d64-356c-4e30-8b72-69782bcff0ce tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:25.686756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e806d64-356c-4e30-8b72-69782bcff0ce tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:25.687196 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e806d64-356c-4e30-8b72-69782bcff0ce tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:25.688131 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e806d64-356c-4e30-8b72-69782bcff0ce tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:25.688774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e806d64-356c-4e30-8b72-69782bcff0ce tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:25.689372 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e806d64-356c-4e30-8b72-69782bcff0ce tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:25.770614 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-bc4dc58d-321f-49cf-9bb7-6c65fa6d7905 req-10f0779b-f35b-410f-85b0-8fa3d4a7fb85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4475905-983f-47fb-8b8e-6c87baeac22d", "name": "network-vif-plugged", "status": "completed", "tag": "3efaeb1f-3500-4863-b27f-c56c1aa2946c"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:14:25.785766 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-bc4dc58d-321f-49cf-9bb7-6c65fa6d7905 req-10f0779b-f35b-410f-85b0-8fa3d4a7fb85 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:25.787269 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-bc4dc58d-321f-49cf-9bb7-6c65fa6d7905 req-10f0779b-f35b-410f-85b0-8fa3d4a7fb85 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:25.788253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-bc4dc58d-321f-49cf-9bb7-6c65fa6d7905 req-10f0779b-f35b-410f-85b0-8fa3d4a7fb85 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:25.801719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-bc4dc58d-321f-49cf-9bb7-6c65fa6d7905 req-10f0779b-f35b-410f-85b0-8fa3d4a7fb85 service nova] Creating event network-vif-plugged:3efaeb1f-3500-4863-b27f-c56c1aa2946c for instance d4475905-983f-47fb-8b8e-6c87baeac22d on hv-cinder-81571 Aug 30 01:14:25.807052 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-bc4dc58d-321f-49cf-9bb7-6c65fa6d7905 req-10f0779b-f35b-410f-85b0-8fa3d4a7fb85 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042565 Aug 30 01:14:25.808077 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 264/541] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:14:25.813615 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-62910762", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:14:25.861606 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2e806d64-356c-4e30-8b72-69782bcff0ce tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:25.871997 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2e806d64-356c-4e30-8b72-69782bcff0ce tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:25.876572 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] validate_networks() for None {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:14:25.902222 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2e806d64-356c-4e30-8b72-69782bcff0ce tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:25.910209 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2e806d64-356c-4e30-8b72-69782bcff0ce tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.235858 Aug 30 01:14:25.922737 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 278/542] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:25 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:25.922737 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-85a51956-6a2b-4d00-bf03-3098d1364299 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:14:25.933691 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-85a51956-6a2b-4d00-bf03-3098d1364299 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:25.934250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-85a51956-6a2b-4d00-bf03-3098d1364299 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:25.934672 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-85a51956-6a2b-4d00-bf03-3098d1364299 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:25.961314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-85a51956-6a2b-4d00-bf03-3098d1364299 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Going to try to stop instance {{(pid=121233) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 01:14:26.154295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-85a51956-6a2b-4d00-bf03-3098d1364299 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "POST /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/action" status: 202 len: 0 microversion: 2.1 time: 0.241694 Aug 30 01:14:26.154899 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 279/543] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 30 01:14:25 2022] POST /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:14:26.163781 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-fbbdaba6-35cd-4b9f-b222-1c4acafc9380 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:26.164795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-fbbdaba6-35cd-4b9f-b222-1c4acafc9380 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:26.171510 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fbbdaba6-35cd-4b9f-b222-1c4acafc9380 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:26.172073 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fbbdaba6-35cd-4b9f-b222-1c4acafc9380 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:26.172604 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fbbdaba6-35cd-4b9f-b222-1c4acafc9380 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:26.173407 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fbbdaba6-35cd-4b9f-b222-1c4acafc9380 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:26.173999 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fbbdaba6-35cd-4b9f-b222-1c4acafc9380 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:26.174484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fbbdaba6-35cd-4b9f-b222-1c4acafc9380 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:26.182529 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:14:26.191325 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:14:26.191830 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:14:26.192248 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:14:26.192663 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:14:26.202365 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:26.202848 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:26.203288 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:26.204021 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:26.204475 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:26.204905 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:26.231108 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Getting quotas for project 1c4cae65522c475fad31e57ae71c3c5f. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:14:26.234650 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Getting quotas for user 9e644ca2991040f8bb1c70599db0cb0f and project 1c4cae65522c475fad31e57ae71c3c5f. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:14:26.246654 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:14:26.249102 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:14:26.316530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-fbbdaba6-35cd-4b9f-b222-1c4acafc9380 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:26.326778 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-fbbdaba6-35cd-4b9f-b222-1c4acafc9380 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1677 microversion: 2.1 time: 0.167562 Aug 30 01:14:26.327612 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 280/544] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:26 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:26.441632 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a1644927-c977-43ad-8895-ae2c6f761b26 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632300 Aug 30 01:14:26.442368 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 265/545] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:14:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:14:26.453720 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0c0297f9-1551-41fa-8255-569d4fb7dd6b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:26.454343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0c0297f9-1551-41fa-8255-569d4fb7dd6b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:26.512219 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0c0297f9-1551-41fa-8255-569d4fb7dd6b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:26.519861 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0c0297f9-1551-41fa-8255-569d4fb7dd6b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1213 microversion: 2.1 time: 0.069816 Aug 30 01:14:26.520521 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 281/546] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:26 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:26.939791 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-178c1d89-4be1-4592-865a-3b9057d094c6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:26.940496 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-178c1d89-4be1-4592-865a-3b9057d094c6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:26.947752 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-178c1d89-4be1-4592-865a-3b9057d094c6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:26.948271 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-178c1d89-4be1-4592-865a-3b9057d094c6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:26.948678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-178c1d89-4be1-4592-865a-3b9057d094c6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:26.949373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-178c1d89-4be1-4592-865a-3b9057d094c6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:26.949854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-178c1d89-4be1-4592-865a-3b9057d094c6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:26.950279 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-178c1d89-4be1-4592-865a-3b9057d094c6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:27.093181 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-178c1d89-4be1-4592-865a-3b9057d094c6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:27.103377 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-178c1d89-4be1-4592-865a-3b9057d094c6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:27.105189 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-178c1d89-4be1-4592-865a-3b9057d094c6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:27.106309 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-178c1d89-4be1-4592-865a-3b9057d094c6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.170465 Aug 30 01:14:27.107307 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 266/547] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:26 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:27.348508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b5f0a036-3e28-4f6f-a6e2-b515eb5b3156 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:27.349979 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b5f0a036-3e28-4f6f-a6e2-b515eb5b3156 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:27.356236 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b5f0a036-3e28-4f6f-a6e2-b515eb5b3156 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:27.356728 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b5f0a036-3e28-4f6f-a6e2-b515eb5b3156 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:27.357245 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b5f0a036-3e28-4f6f-a6e2-b515eb5b3156 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:27.357986 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b5f0a036-3e28-4f6f-a6e2-b515eb5b3156 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:27.358445 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b5f0a036-3e28-4f6f-a6e2-b515eb5b3156 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:27.358872 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b5f0a036-3e28-4f6f-a6e2-b515eb5b3156 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:27.502472 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-b5f0a036-3e28-4f6f-a6e2-b515eb5b3156 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:27.511128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-b5f0a036-3e28-4f6f-a6e2-b515eb5b3156 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1677 microversion: 2.1 time: 0.166657 Aug 30 01:14:27.511697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 282/548] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:27 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:27.540616 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-efb13011-98e7-46fc-a401-37e475129bd7 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:27.541230 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-efb13011-98e7-46fc-a401-37e475129bd7 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:27.547456 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-efb13011-98e7-46fc-a401-37e475129bd7 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:27.547927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-efb13011-98e7-46fc-a401-37e475129bd7 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:27.548356 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-efb13011-98e7-46fc-a401-37e475129bd7 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:27.549028 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-efb13011-98e7-46fc-a401-37e475129bd7 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:27.549474 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-efb13011-98e7-46fc-a401-37e475129bd7 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:27.549928 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-efb13011-98e7-46fc-a401-37e475129bd7 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:27.612490 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-efb13011-98e7-46fc-a401-37e475129bd7 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:27.620977 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-efb13011-98e7-46fc-a401-37e475129bd7 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1217 microversion: 2.1 time: 0.084461 Aug 30 01:14:27.621617 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 267/549] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:27 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:28.130256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-be41a882-bafe-44ca-aac5-5a34789728d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:28.130866 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-be41a882-bafe-44ca-aac5-5a34789728d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:28.138085 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-be41a882-bafe-44ca-aac5-5a34789728d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:28.143311 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-be41a882-bafe-44ca-aac5-5a34789728d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:28.143311 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-be41a882-bafe-44ca-aac5-5a34789728d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:28.143311 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-be41a882-bafe-44ca-aac5-5a34789728d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:28.143311 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-be41a882-bafe-44ca-aac5-5a34789728d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:28.143966 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-be41a882-bafe-44ca-aac5-5a34789728d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:28.293483 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-be41a882-bafe-44ca-aac5-5a34789728d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:28.305363 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-be41a882-bafe-44ca-aac5-5a34789728d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:28.306871 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-be41a882-bafe-44ca-aac5-5a34789728d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:28.308044 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-be41a882-bafe-44ca-aac5-5a34789728d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.181903 Aug 30 01:14:28.308835 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 283/550] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:28 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:28.532227 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c029ff8e-9d80-4fe2-b944-1fe4dff459f7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:28.532831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c029ff8e-9d80-4fe2-b944-1fe4dff459f7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:28.538900 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c029ff8e-9d80-4fe2-b944-1fe4dff459f7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:28.539378 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c029ff8e-9d80-4fe2-b944-1fe4dff459f7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:28.539814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c029ff8e-9d80-4fe2-b944-1fe4dff459f7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:28.540499 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c029ff8e-9d80-4fe2-b944-1fe4dff459f7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:28.540957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c029ff8e-9d80-4fe2-b944-1fe4dff459f7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:28.544374 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c029ff8e-9d80-4fe2-b944-1fe4dff459f7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:28.642561 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-1b8412e6-67b5-429c-8cca-6ff0bf11125b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:28.643175 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-1b8412e6-67b5-429c-8cca-6ff0bf11125b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:28.649958 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1b8412e6-67b5-429c-8cca-6ff0bf11125b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:28.650544 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1b8412e6-67b5-429c-8cca-6ff0bf11125b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:28.651074 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1b8412e6-67b5-429c-8cca-6ff0bf11125b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:28.651782 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1b8412e6-67b5-429c-8cca-6ff0bf11125b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:28.652241 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1b8412e6-67b5-429c-8cca-6ff0bf11125b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:28.652704 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1b8412e6-67b5-429c-8cca-6ff0bf11125b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:28.684411 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c029ff8e-9d80-4fe2-b944-1fe4dff459f7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:28.692598 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c029ff8e-9d80-4fe2-b944-1fe4dff459f7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1677 microversion: 2.1 time: 0.164326 Aug 30 01:14:28.693254 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 268/551] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:28 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:28.717295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-1b8412e6-67b5-429c-8cca-6ff0bf11125b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:28.725930 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-1b8412e6-67b5-429c-8cca-6ff0bf11125b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1265 microversion: 2.1 time: 0.086543 Aug 30 01:14:28.749245 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 284/552] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:28 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:29.331552 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d0a52f57-ca70-4f30-b525-a70ecd7349e4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:29.332167 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d0a52f57-ca70-4f30-b525-a70ecd7349e4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:29.338386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0a52f57-ca70-4f30-b525-a70ecd7349e4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:29.338939 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0a52f57-ca70-4f30-b525-a70ecd7349e4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:29.339315 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0a52f57-ca70-4f30-b525-a70ecd7349e4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:29.340037 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0a52f57-ca70-4f30-b525-a70ecd7349e4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:29.340496 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0a52f57-ca70-4f30-b525-a70ecd7349e4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:29.340982 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0a52f57-ca70-4f30-b525-a70ecd7349e4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:29.481314 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d0a52f57-ca70-4f30-b525-a70ecd7349e4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:29.491020 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d0a52f57-ca70-4f30-b525-a70ecd7349e4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:29.493067 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d0a52f57-ca70-4f30-b525-a70ecd7349e4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:29.494373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d0a52f57-ca70-4f30-b525-a70ecd7349e4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.166931 Aug 30 01:14:29.494957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 269/553] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:29 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:14:29.715778 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c12db459-5f49-4d49-8247-7b6512959bbf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:29.716381 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c12db459-5f49-4d49-8247-7b6512959bbf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:29.723469 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c12db459-5f49-4d49-8247-7b6512959bbf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:29.723998 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c12db459-5f49-4d49-8247-7b6512959bbf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:29.724401 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c12db459-5f49-4d49-8247-7b6512959bbf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:29.725114 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c12db459-5f49-4d49-8247-7b6512959bbf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:29.726103 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c12db459-5f49-4d49-8247-7b6512959bbf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:29.726541 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c12db459-5f49-4d49-8247-7b6512959bbf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:29.768459 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c61e7aa9-5c72-44f0-9695-146afa16a824 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:29.769162 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c61e7aa9-5c72-44f0-9695-146afa16a824 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:29.776970 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c61e7aa9-5c72-44f0-9695-146afa16a824 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:29.777568 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c61e7aa9-5c72-44f0-9695-146afa16a824 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:29.778042 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c61e7aa9-5c72-44f0-9695-146afa16a824 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:29.778747 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c61e7aa9-5c72-44f0-9695-146afa16a824 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:29.779237 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c61e7aa9-5c72-44f0-9695-146afa16a824 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:29.779663 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c61e7aa9-5c72-44f0-9695-146afa16a824 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:29.847557 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c61e7aa9-5c72-44f0-9695-146afa16a824 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:29.856101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c61e7aa9-5c72-44f0-9695-146afa16a824 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1265 microversion: 2.1 time: 0.091468 Aug 30 01:14:29.869416 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 270/554] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:29 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:29.871938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c12db459-5f49-4d49-8247-7b6512959bbf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:29.875687 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:29.880502 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c12db459-5f49-4d49-8247-7b6512959bbf tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1677 microversion: 2.1 time: 0.170310 Aug 30 01:14:29.881077 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 285/555] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:29 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:30.518685 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-db1fc2c9-33bf-4898-87a9-52f8101d75e3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:30.519062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-db1fc2c9-33bf-4898-87a9-52f8101d75e3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:30.525844 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db1fc2c9-33bf-4898-87a9-52f8101d75e3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:30.526561 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db1fc2c9-33bf-4898-87a9-52f8101d75e3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:30.526992 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db1fc2c9-33bf-4898-87a9-52f8101d75e3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:30.533926 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db1fc2c9-33bf-4898-87a9-52f8101d75e3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:30.533926 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db1fc2c9-33bf-4898-87a9-52f8101d75e3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:30.533926 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db1fc2c9-33bf-4898-87a9-52f8101d75e3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:30.768349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-db1fc2c9-33bf-4898-87a9-52f8101d75e3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:30.779283 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-db1fc2c9-33bf-4898-87a9-52f8101d75e3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:30.782417 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-db1fc2c9-33bf-4898-87a9-52f8101d75e3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:30.783860 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-db1fc2c9-33bf-4898-87a9-52f8101d75e3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1808 microversion: 2.20 time: 0.269466 Aug 30 01:14:30.790463 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 271/556] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:30 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:14:30.877792 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-78180496-7964-4c71-a229-99f0c75a23a3 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:30.878452 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-78180496-7964-4c71-a229-99f0c75a23a3 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:30.886659 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-78180496-7964-4c71-a229-99f0c75a23a3 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:30.887145 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-78180496-7964-4c71-a229-99f0c75a23a3 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:30.887580 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-78180496-7964-4c71-a229-99f0c75a23a3 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:30.888291 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-78180496-7964-4c71-a229-99f0c75a23a3 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:30.888749 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-78180496-7964-4c71-a229-99f0c75a23a3 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:30.889177 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-78180496-7964-4c71-a229-99f0c75a23a3 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:30.901118 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a7bfec74-4881-4aa8-b35a-fa8d7eea957b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:30.902115 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a7bfec74-4881-4aa8-b35a-fa8d7eea957b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:30.908712 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7bfec74-4881-4aa8-b35a-fa8d7eea957b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:30.909362 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7bfec74-4881-4aa8-b35a-fa8d7eea957b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:30.909936 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7bfec74-4881-4aa8-b35a-fa8d7eea957b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:30.910766 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7bfec74-4881-4aa8-b35a-fa8d7eea957b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:30.911325 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7bfec74-4881-4aa8-b35a-fa8d7eea957b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:30.912126 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7bfec74-4881-4aa8-b35a-fa8d7eea957b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:30.977498 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-78180496-7964-4c71-a229-99f0c75a23a3 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:30.985449 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-78180496-7964-4c71-a229-99f0c75a23a3 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1271 microversion: 2.1 time: 0.111551 Aug 30 01:14:30.986061 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 286/557] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:30 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1271 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:31.061929 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a7bfec74-4881-4aa8-b35a-fa8d7eea957b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:31.070518 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a7bfec74-4881-4aa8-b35a-fa8d7eea957b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1677 microversion: 2.1 time: 0.173881 Aug 30 01:14:31.071111 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 272/558] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:30 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:31.822143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-bb2b87f2-07ab-44b2-8907-3b7fcfe961c1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:31.822808 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-bb2b87f2-07ab-44b2-8907-3b7fcfe961c1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:31.829912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bb2b87f2-07ab-44b2-8907-3b7fcfe961c1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:31.830636 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bb2b87f2-07ab-44b2-8907-3b7fcfe961c1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:31.831074 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bb2b87f2-07ab-44b2-8907-3b7fcfe961c1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:31.831991 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bb2b87f2-07ab-44b2-8907-3b7fcfe961c1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:31.832770 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bb2b87f2-07ab-44b2-8907-3b7fcfe961c1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:31.833173 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bb2b87f2-07ab-44b2-8907-3b7fcfe961c1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:31.973630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-bb2b87f2-07ab-44b2-8907-3b7fcfe961c1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:31.984006 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-bb2b87f2-07ab-44b2-8907-3b7fcfe961c1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:31.985447 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-bb2b87f2-07ab-44b2-8907-3b7fcfe961c1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:31.986719 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-bb2b87f2-07ab-44b2-8907-3b7fcfe961c1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1795 microversion: 2.20 time: 0.169703 Aug 30 01:14:31.987301 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 287/559] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:14:31 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1795 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:14:32.006812 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8f003f9b-6f7c-47fb-acb3-cdfbd4fc0266 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:32.007479 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8f003f9b-6f7c-47fb-acb3-cdfbd4fc0266 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:32.009529 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:32.014421 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f003f9b-6f7c-47fb-acb3-cdfbd4fc0266 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:32.014895 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f003f9b-6f7c-47fb-acb3-cdfbd4fc0266 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:32.018104 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f003f9b-6f7c-47fb-acb3-cdfbd4fc0266 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:32.018104 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f003f9b-6f7c-47fb-acb3-cdfbd4fc0266 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:32.018104 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f003f9b-6f7c-47fb-acb3-cdfbd4fc0266 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:32.018104 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f003f9b-6f7c-47fb-acb3-cdfbd4fc0266 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:32.092236 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6c719842-f7a3-4dde-ae0e-6f9b39e2c73f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:32.092995 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6c719842-f7a3-4dde-ae0e-6f9b39e2c73f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:32.099251 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c719842-f7a3-4dde-ae0e-6f9b39e2c73f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:32.099828 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c719842-f7a3-4dde-ae0e-6f9b39e2c73f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:32.100895 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c719842-f7a3-4dde-ae0e-6f9b39e2c73f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:32.101621 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c719842-f7a3-4dde-ae0e-6f9b39e2c73f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:32.102176 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c719842-f7a3-4dde-ae0e-6f9b39e2c73f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:32.102716 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c719842-f7a3-4dde-ae0e-6f9b39e2c73f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:32.216904 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8f003f9b-6f7c-47fb-acb3-cdfbd4fc0266 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:32.226652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8f003f9b-6f7c-47fb-acb3-cdfbd4fc0266 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1313 microversion: 2.1 time: 0.223812 Aug 30 01:14:32.227251 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 273/560] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:32 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:32.232286 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-64c9c8f4-6afb-45ef-a9b0-57e39c5a8de2 req-e969880b-bfcf-4932-8b79-41d077362288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cf0e034-70be-4033-9fbf-6ae7f32c895e", "tag": "c9469186-90f0-4715-85c3-8c8b2fd48e3c"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:14:32.243143 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-64c9c8f4-6afb-45ef-a9b0-57e39c5a8de2 req-e969880b-bfcf-4932-8b79-41d077362288 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:32.243609 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-64c9c8f4-6afb-45ef-a9b0-57e39c5a8de2 req-e969880b-bfcf-4932-8b79-41d077362288 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:32.244049 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-64c9c8f4-6afb-45ef-a9b0-57e39c5a8de2 req-e969880b-bfcf-4932-8b79-41d077362288 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:32.256107 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-64c9c8f4-6afb-45ef-a9b0-57e39c5a8de2 req-e969880b-bfcf-4932-8b79-41d077362288 service nova] Creating event network-changed:c9469186-90f0-4715-85c3-8c8b2fd48e3c for instance 6cf0e034-70be-4033-9fbf-6ae7f32c895e on hv-cinder-81571 Aug 30 01:14:32.262808 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-64c9c8f4-6afb-45ef-a9b0-57e39c5a8de2 req-e969880b-bfcf-4932-8b79-41d077362288 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033243 Aug 30 01:14:32.262972 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6c719842-f7a3-4dde-ae0e-6f9b39e2c73f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:32.263099 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 274/561] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:14:32.270299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6c719842-f7a3-4dde-ae0e-6f9b39e2c73f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1677 microversion: 2.1 time: 0.181945 Aug 30 01:14:32.270871 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 288/562] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:32 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:33.248629 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8ac63550-6548-4112-aba6-2dc7b46a7203 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:33.249429 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8ac63550-6548-4112-aba6-2dc7b46a7203 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:33.255887 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ac63550-6548-4112-aba6-2dc7b46a7203 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:33.256372 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ac63550-6548-4112-aba6-2dc7b46a7203 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:33.257558 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ac63550-6548-4112-aba6-2dc7b46a7203 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:33.258374 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ac63550-6548-4112-aba6-2dc7b46a7203 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:33.258833 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ac63550-6548-4112-aba6-2dc7b46a7203 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:33.259263 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ac63550-6548-4112-aba6-2dc7b46a7203 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:33.291941 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9d08dfb2-bce4-45fe-bffd-8cd081414483 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:33.292549 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9d08dfb2-bce4-45fe-bffd-8cd081414483 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:33.295343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=44 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:33.300298 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d08dfb2-bce4-45fe-bffd-8cd081414483 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:33.300982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d08dfb2-bce4-45fe-bffd-8cd081414483 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:33.301416 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d08dfb2-bce4-45fe-bffd-8cd081414483 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:33.302233 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d08dfb2-bce4-45fe-bffd-8cd081414483 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:33.302683 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d08dfb2-bce4-45fe-bffd-8cd081414483 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:33.303161 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d08dfb2-bce4-45fe-bffd-8cd081414483 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:33.403143 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8ac63550-6548-4112-aba6-2dc7b46a7203 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:33.411486 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8ac63550-6548-4112-aba6-2dc7b46a7203 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1313 microversion: 2.1 time: 0.166985 Aug 30 01:14:33.412072 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 275/563] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:33 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:33.454646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9d08dfb2-bce4-45fe-bffd-8cd081414483 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:33.463145 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9d08dfb2-bce4-45fe-bffd-8cd081414483 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1677 microversion: 2.1 time: 0.175198 Aug 30 01:14:33.463818 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 289/564] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:33 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:34.434622 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3c1caa63-5230-4d58-9758-bb2ec75a76a2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:34.435550 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3c1caa63-5230-4d58-9758-bb2ec75a76a2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:34.441548 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c1caa63-5230-4d58-9758-bb2ec75a76a2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:34.442142 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c1caa63-5230-4d58-9758-bb2ec75a76a2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:34.442641 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c1caa63-5230-4d58-9758-bb2ec75a76a2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:34.443470 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c1caa63-5230-4d58-9758-bb2ec75a76a2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:34.445032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c1caa63-5230-4d58-9758-bb2ec75a76a2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:34.445824 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c1caa63-5230-4d58-9758-bb2ec75a76a2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:34.484857 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-cc8d3046-ad51-43ff-b64a-be61a62c22ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:34.486174 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-cc8d3046-ad51-43ff-b64a-be61a62c22ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:34.495636 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc8d3046-ad51-43ff-b64a-be61a62c22ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:34.496444 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc8d3046-ad51-43ff-b64a-be61a62c22ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:34.497101 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc8d3046-ad51-43ff-b64a-be61a62c22ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:34.498126 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc8d3046-ad51-43ff-b64a-be61a62c22ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:34.498582 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc8d3046-ad51-43ff-b64a-be61a62c22ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:34.499276 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc8d3046-ad51-43ff-b64a-be61a62c22ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:34.652649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-cc8d3046-ad51-43ff-b64a-be61a62c22ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:34.663782 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-cc8d3046-ad51-43ff-b64a-be61a62c22ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1677 microversion: 2.1 time: 0.182580 Aug 30 01:14:34.664366 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 290/565] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:34 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:34.691268 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3c1caa63-5230-4d58-9758-bb2ec75a76a2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:34.699642 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3c1caa63-5230-4d58-9758-bb2ec75a76a2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1313 microversion: 2.1 time: 0.270988 Aug 30 01:14:34.700222 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 276/566] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:34 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:35.686038 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2da2f3e6-8383-4940-96a7-4ff51338d1aa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:35.686572 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2da2f3e6-8383-4940-96a7-4ff51338d1aa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:35.693245 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2da2f3e6-8383-4940-96a7-4ff51338d1aa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:35.693747 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2da2f3e6-8383-4940-96a7-4ff51338d1aa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:35.694252 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2da2f3e6-8383-4940-96a7-4ff51338d1aa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:35.694959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2da2f3e6-8383-4940-96a7-4ff51338d1aa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:35.695433 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2da2f3e6-8383-4940-96a7-4ff51338d1aa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:35.695854 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2da2f3e6-8383-4940-96a7-4ff51338d1aa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:35.721973 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-43af5024-7f8a-4c68-b06d-9258f5210d76 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:35.722831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-43af5024-7f8a-4c68-b06d-9258f5210d76 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:35.731064 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43af5024-7f8a-4c68-b06d-9258f5210d76 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:35.731749 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43af5024-7f8a-4c68-b06d-9258f5210d76 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:35.732364 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43af5024-7f8a-4c68-b06d-9258f5210d76 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:35.733209 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43af5024-7f8a-4c68-b06d-9258f5210d76 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:35.733832 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43af5024-7f8a-4c68-b06d-9258f5210d76 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:35.734333 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-43af5024-7f8a-4c68-b06d-9258f5210d76 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:35.850794 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2da2f3e6-8383-4940-96a7-4ff51338d1aa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:35.859879 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2da2f3e6-8383-4940-96a7-4ff51338d1aa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1677 microversion: 2.1 time: 0.177894 Aug 30 01:14:35.860869 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 291/567] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:35 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:35.894751 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-43af5024-7f8a-4c68-b06d-9258f5210d76 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:35.903583 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-43af5024-7f8a-4c68-b06d-9258f5210d76 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1313 microversion: 2.1 time: 0.185593 Aug 30 01:14:35.904179 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 277/568] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:35 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:36.881503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-dc54c1af-ab56-42b0-ad7f-f9005d8b75ce tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:36.882645 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-dc54c1af-ab56-42b0-ad7f-f9005d8b75ce tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:36.888574 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=2 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:36.895898 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dc54c1af-ab56-42b0-ad7f-f9005d8b75ce tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:36.896539 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dc54c1af-ab56-42b0-ad7f-f9005d8b75ce tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:36.897702 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dc54c1af-ab56-42b0-ad7f-f9005d8b75ce tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:36.898253 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dc54c1af-ab56-42b0-ad7f-f9005d8b75ce tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:36.898801 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dc54c1af-ab56-42b0-ad7f-f9005d8b75ce tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:36.899538 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dc54c1af-ab56-42b0-ad7f-f9005d8b75ce tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:36.924743 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1e0ce26d-6714-4b3e-972c-471b4231030e tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:36.925449 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1e0ce26d-6714-4b3e-972c-471b4231030e tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:36.933793 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:36.933793 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=6 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:36.935149 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e0ce26d-6714-4b3e-972c-471b4231030e tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:36.935654 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e0ce26d-6714-4b3e-972c-471b4231030e tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:36.936090 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e0ce26d-6714-4b3e-972c-471b4231030e tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:36.936805 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e0ce26d-6714-4b3e-972c-471b4231030e tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:36.937303 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e0ce26d-6714-4b3e-972c-471b4231030e tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:36.937755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e0ce26d-6714-4b3e-972c-471b4231030e tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:37.099521 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-dc54c1af-ab56-42b0-ad7f-f9005d8b75ce tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:37.109366 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-dc54c1af-ab56-42b0-ad7f-f9005d8b75ce tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1677 microversion: 2.1 time: 0.231902 Aug 30 01:14:37.110172 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 292/569] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:36 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:37.127683 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1e0ce26d-6714-4b3e-972c-471b4231030e tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:37.136615 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1e0ce26d-6714-4b3e-972c-471b4231030e tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1313 microversion: 2.1 time: 0.215643 Aug 30 01:14:37.137403 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 278/570] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:36 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:37.885759 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-f59b0ce5-5897-4be6-9ac8-2dbbf5473d60 req-e0efb56e-fd93-4767-91c5-2b4c320032d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf0e034-70be-4033-9fbf-6ae7f32c895e", "name": "network-vif-plugged", "status": "completed", "tag": "c9469186-90f0-4715-85c3-8c8b2fd48e3c"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:14:37.898273 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-f59b0ce5-5897-4be6-9ac8-2dbbf5473d60 req-e0efb56e-fd93-4767-91c5-2b4c320032d5 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:37.898755 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-f59b0ce5-5897-4be6-9ac8-2dbbf5473d60 req-e0efb56e-fd93-4767-91c5-2b4c320032d5 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:37.899360 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-f59b0ce5-5897-4be6-9ac8-2dbbf5473d60 req-e0efb56e-fd93-4767-91c5-2b4c320032d5 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:37.911011 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-f59b0ce5-5897-4be6-9ac8-2dbbf5473d60 req-e0efb56e-fd93-4767-91c5-2b4c320032d5 service nova] Creating event network-vif-plugged:c9469186-90f0-4715-85c3-8c8b2fd48e3c for instance 6cf0e034-70be-4033-9fbf-6ae7f32c895e on hv-cinder-81571 Aug 30 01:14:37.917016 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-f59b0ce5-5897-4be6-9ac8-2dbbf5473d60 req-e0efb56e-fd93-4767-91c5-2b4c320032d5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036074 Aug 30 01:14:37.919193 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 293/571] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:14:38.135260 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-07343525-d33e-410a-b35e-b38ae16c7181 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:38.135849 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-07343525-d33e-410a-b35e-b38ae16c7181 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:38.142657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07343525-d33e-410a-b35e-b38ae16c7181 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:38.143181 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07343525-d33e-410a-b35e-b38ae16c7181 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:38.143615 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07343525-d33e-410a-b35e-b38ae16c7181 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:38.144309 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07343525-d33e-410a-b35e-b38ae16c7181 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:38.150453 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07343525-d33e-410a-b35e-b38ae16c7181 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:38.150453 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07343525-d33e-410a-b35e-b38ae16c7181 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:38.159866 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-956a96cc-7405-4620-8851-6df35ba91058 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:38.160884 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-956a96cc-7405-4620-8851-6df35ba91058 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:38.168263 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-956a96cc-7405-4620-8851-6df35ba91058 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:38.169001 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-956a96cc-7405-4620-8851-6df35ba91058 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:38.169621 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-956a96cc-7405-4620-8851-6df35ba91058 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:38.170360 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-956a96cc-7405-4620-8851-6df35ba91058 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:38.170818 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-956a96cc-7405-4620-8851-6df35ba91058 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:38.171309 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-956a96cc-7405-4620-8851-6df35ba91058 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:38.281874 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-07343525-d33e-410a-b35e-b38ae16c7181 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:38.298291 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-07343525-d33e-410a-b35e-b38ae16c7181 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1654 microversion: 2.1 time: 0.167411 Aug 30 01:14:38.299056 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 279/572] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:38 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1654 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:38.316235 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-956a96cc-7405-4620-8851-6df35ba91058 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:38.320616 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f2e391fd-62ca-41a0-9f91-8ab37ba04a8f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:14:38.326273 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-956a96cc-7405-4620-8851-6df35ba91058 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1313 microversion: 2.1 time: 0.170713 Aug 30 01:14:38.327056 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 294/573] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:38 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:38.327446 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f2e391fd-62ca-41a0-9f91-8ab37ba04a8f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:38.328030 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f2e391fd-62ca-41a0-9f91-8ab37ba04a8f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:38.328464 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f2e391fd-62ca-41a0-9f91-8ab37ba04a8f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:38.391287 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f2e391fd-62ca-41a0-9f91-8ab37ba04a8f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Going to try to start instance {{(pid=121232) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 01:14:38.553859 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:38.703141 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f2e391fd-62ca-41a0-9f91-8ab37ba04a8f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "POST /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/action" status: 202 len: 0 microversion: 2.1 time: 0.387028 Aug 30 01:14:38.703682 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 280/574] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 30 01:14:38 2022] POST /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:14:38.714780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-bfc91e09-998e-401c-a782-e6ba50f66128 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:38.715381 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-bfc91e09-998e-401c-a782-e6ba50f66128 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:38.721671 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bfc91e09-998e-401c-a782-e6ba50f66128 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:38.722195 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bfc91e09-998e-401c-a782-e6ba50f66128 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:38.722624 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bfc91e09-998e-401c-a782-e6ba50f66128 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:38.723315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bfc91e09-998e-401c-a782-e6ba50f66128 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:38.723764 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bfc91e09-998e-401c-a782-e6ba50f66128 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:38.724184 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bfc91e09-998e-401c-a782-e6ba50f66128 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:38.861554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-bfc91e09-998e-401c-a782-e6ba50f66128 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:38.870759 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-bfc91e09-998e-401c-a782-e6ba50f66128 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1663 microversion: 2.1 time: 0.159705 Aug 30 01:14:38.871326 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 295/575] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:38 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:39.348930 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a5f586d4-3826-476b-88b8-9d066c74b29d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:39.349661 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a5f586d4-3826-476b-88b8-9d066c74b29d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:39.357163 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5f586d4-3826-476b-88b8-9d066c74b29d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:39.357645 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5f586d4-3826-476b-88b8-9d066c74b29d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:39.358107 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5f586d4-3826-476b-88b8-9d066c74b29d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:39.358802 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5f586d4-3826-476b-88b8-9d066c74b29d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:39.359252 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5f586d4-3826-476b-88b8-9d066c74b29d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:39.359708 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5f586d4-3826-476b-88b8-9d066c74b29d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:39.525779 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a5f586d4-3826-476b-88b8-9d066c74b29d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:39.533407 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a5f586d4-3826-476b-88b8-9d066c74b29d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1313 microversion: 2.1 time: 0.189282 Aug 30 01:14:39.534028 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 281/576] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:39 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:39.893967 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6388ee9f-9668-4719-b602-277ea5b0ec71 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:39.894628 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6388ee9f-9668-4719-b602-277ea5b0ec71 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:39.901248 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6388ee9f-9668-4719-b602-277ea5b0ec71 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:39.903527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6388ee9f-9668-4719-b602-277ea5b0ec71 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:39.903527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6388ee9f-9668-4719-b602-277ea5b0ec71 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:39.903527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6388ee9f-9668-4719-b602-277ea5b0ec71 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:39.903527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6388ee9f-9668-4719-b602-277ea5b0ec71 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:39.903879 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6388ee9f-9668-4719-b602-277ea5b0ec71 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:40.040089 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6388ee9f-9668-4719-b602-277ea5b0ec71 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:40.048304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6388ee9f-9668-4719-b602-277ea5b0ec71 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1663 microversion: 2.1 time: 0.159316 Aug 30 01:14:40.048884 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 296/577] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:39 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:40.556115 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1e804b69-e8da-4064-b07c-8e2da188cca0 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:40.557288 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1e804b69-e8da-4064-b07c-8e2da188cca0 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:40.563633 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e804b69-e8da-4064-b07c-8e2da188cca0 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:40.564128 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e804b69-e8da-4064-b07c-8e2da188cca0 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:40.564568 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e804b69-e8da-4064-b07c-8e2da188cca0 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:40.565273 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e804b69-e8da-4064-b07c-8e2da188cca0 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:40.565817 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e804b69-e8da-4064-b07c-8e2da188cca0 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:40.566470 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e804b69-e8da-4064-b07c-8e2da188cca0 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:40.767495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1e804b69-e8da-4064-b07c-8e2da188cca0 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:40.776745 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1e804b69-e8da-4064-b07c-8e2da188cca0 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1313 microversion: 2.1 time: 0.224867 Aug 30 01:14:40.777342 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 282/578] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:40 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:41.069099 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b62aa2e1-2659-4cf8-9590-34ffd1a1d01e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:41.069716 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b62aa2e1-2659-4cf8-9590-34ffd1a1d01e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:41.076302 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b62aa2e1-2659-4cf8-9590-34ffd1a1d01e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:41.076786 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b62aa2e1-2659-4cf8-9590-34ffd1a1d01e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:41.077225 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b62aa2e1-2659-4cf8-9590-34ffd1a1d01e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:41.077947 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b62aa2e1-2659-4cf8-9590-34ffd1a1d01e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:41.078408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b62aa2e1-2659-4cf8-9590-34ffd1a1d01e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:41.078835 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b62aa2e1-2659-4cf8-9590-34ffd1a1d01e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:41.209134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-b62aa2e1-2659-4cf8-9590-34ffd1a1d01e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:41.217433 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-b62aa2e1-2659-4cf8-9590-34ffd1a1d01e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1663 microversion: 2.1 time: 0.152189 Aug 30 01:14:41.218031 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 297/579] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:41 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:41.798271 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2e994898-196d-44bc-8331-bfc9bf8fe02b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:41.798875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2e994898-196d-44bc-8331-bfc9bf8fe02b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:41.805401 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e994898-196d-44bc-8331-bfc9bf8fe02b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:41.805905 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e994898-196d-44bc-8331-bfc9bf8fe02b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:41.806335 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e994898-196d-44bc-8331-bfc9bf8fe02b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:41.807009 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e994898-196d-44bc-8331-bfc9bf8fe02b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:41.807458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e994898-196d-44bc-8331-bfc9bf8fe02b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:41.807874 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e994898-196d-44bc-8331-bfc9bf8fe02b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:41.953946 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2e994898-196d-44bc-8331-bfc9bf8fe02b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:41.957461 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2e994898-196d-44bc-8331-bfc9bf8fe02b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1463 microversion: 2.1 time: 0.163033 Aug 30 01:14:41.958069 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 283/580] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:41 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:42.005274 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-15b8e769-c751-4415-bac0-87a201b57465 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:42.005783 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-15b8e769-c751-4415-bac0-87a201b57465 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:42.011822 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15b8e769-c751-4415-bac0-87a201b57465 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:42.012297 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15b8e769-c751-4415-bac0-87a201b57465 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:42.012726 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15b8e769-c751-4415-bac0-87a201b57465 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:42.013404 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15b8e769-c751-4415-bac0-87a201b57465 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:42.013892 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15b8e769-c751-4415-bac0-87a201b57465 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:42.014309 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15b8e769-c751-4415-bac0-87a201b57465 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:42.040364 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-15b8e769-c751-4415-bac0-87a201b57465 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Going to try to terminate instance {{(pid=121233) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:14:42.239692 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-236d10ac-a59a-4c02-ab8c-9c594e6c5ef5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:42.240226 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-236d10ac-a59a-4c02-ab8c-9c594e6c5ef5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:42.246438 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-236d10ac-a59a-4c02-ab8c-9c594e6c5ef5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:42.246925 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-236d10ac-a59a-4c02-ab8c-9c594e6c5ef5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:42.247364 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-236d10ac-a59a-4c02-ab8c-9c594e6c5ef5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:42.248055 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-236d10ac-a59a-4c02-ab8c-9c594e6c5ef5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:42.248509 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-236d10ac-a59a-4c02-ab8c-9c594e6c5ef5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:42.248933 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-236d10ac-a59a-4c02-ab8c-9c594e6c5ef5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:42.387445 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-236d10ac-a59a-4c02-ab8c-9c594e6c5ef5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:42.390740 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-15b8e769-c751-4415-bac0-87a201b57465 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 204 len: 0 microversion: 2.1 time: 0.388917 Aug 30 01:14:42.391390 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 298/581] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:14:42 2022] DELETE /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:14:42.397048 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-236d10ac-a59a-4c02-ab8c-9c594e6c5ef5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1663 microversion: 2.1 time: 0.161339 Aug 30 01:14:42.397838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 284/582] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:42 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1663 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:42.403167 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c5cfb157-acc4-4a80-95aa-c9b163f4039f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:42.403961 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c5cfb157-acc4-4a80-95aa-c9b163f4039f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:42.412219 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c5cfb157-acc4-4a80-95aa-c9b163f4039f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:42.412219 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c5cfb157-acc4-4a80-95aa-c9b163f4039f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:42.412219 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c5cfb157-acc4-4a80-95aa-c9b163f4039f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:42.412750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c5cfb157-acc4-4a80-95aa-c9b163f4039f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:42.413049 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c5cfb157-acc4-4a80-95aa-c9b163f4039f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:42.413472 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c5cfb157-acc4-4a80-95aa-c9b163f4039f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:42.544547 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c5cfb157-acc4-4a80-95aa-c9b163f4039f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:42.552236 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c5cfb157-acc4-4a80-95aa-c9b163f4039f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1469 microversion: 2.1 time: 0.156433 Aug 30 01:14:42.552812 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 299/583] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:42 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:43.422584 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5b6d438c-8282-4211-afc4-93e98dfa9588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:43.423339 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5b6d438c-8282-4211-afc4-93e98dfa9588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:43.429754 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b6d438c-8282-4211-afc4-93e98dfa9588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:43.430508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b6d438c-8282-4211-afc4-93e98dfa9588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:43.430948 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b6d438c-8282-4211-afc4-93e98dfa9588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:43.431647 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b6d438c-8282-4211-afc4-93e98dfa9588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:43.432105 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b6d438c-8282-4211-afc4-93e98dfa9588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:43.432540 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b6d438c-8282-4211-afc4-93e98dfa9588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:43.568708 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5b6d438c-8282-4211-afc4-93e98dfa9588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:43.574531 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-eda9d5a7-68ff-4eee-8095-fdfb626fd7be tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:43.575281 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-eda9d5a7-68ff-4eee-8095-fdfb626fd7be tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:43.577520 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5b6d438c-8282-4211-afc4-93e98dfa9588 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1663 microversion: 2.1 time: 0.158876 Aug 30 01:14:43.578129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 285/584] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:43 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:43.582071 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-eda9d5a7-68ff-4eee-8095-fdfb626fd7be tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:43.582805 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-eda9d5a7-68ff-4eee-8095-fdfb626fd7be tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:43.583318 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-eda9d5a7-68ff-4eee-8095-fdfb626fd7be tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:43.584101 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-eda9d5a7-68ff-4eee-8095-fdfb626fd7be tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:43.584636 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-eda9d5a7-68ff-4eee-8095-fdfb626fd7be tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:43.585073 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-eda9d5a7-68ff-4eee-8095-fdfb626fd7be tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:43.650814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5ceee977-b7db-472b-a0d1-f1aaf219288d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47f563a0-540e-4e8c-8f8a-6a8f6619e06e"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:14:43.653137 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5ceee977-b7db-472b-a0d1-f1aaf219288d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:43.659199 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ceee977-b7db-472b-a0d1-f1aaf219288d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:43.659681 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ceee977-b7db-472b-a0d1-f1aaf219288d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:43.660126 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ceee977-b7db-472b-a0d1-f1aaf219288d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:43.660824 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ceee977-b7db-472b-a0d1-f1aaf219288d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:43.661278 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ceee977-b7db-472b-a0d1-f1aaf219288d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:43.661705 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ceee977-b7db-472b-a0d1-f1aaf219288d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:43.727419 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-eda9d5a7-68ff-4eee-8095-fdfb626fd7be tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:43.735726 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-eda9d5a7-68ff-4eee-8095-fdfb626fd7be tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1469 microversion: 2.1 time: 0.165702 Aug 30 01:14:43.739213 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 300/585] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:43 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:44.599867 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e56c58f3-4a1a-4b3c-8015-e72d2635999a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:44.600532 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e56c58f3-4a1a-4b3c-8015-e72d2635999a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:44.607284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e56c58f3-4a1a-4b3c-8015-e72d2635999a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:44.613864 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e56c58f3-4a1a-4b3c-8015-e72d2635999a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:44.613864 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e56c58f3-4a1a-4b3c-8015-e72d2635999a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:44.613864 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e56c58f3-4a1a-4b3c-8015-e72d2635999a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:44.613864 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e56c58f3-4a1a-4b3c-8015-e72d2635999a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:44.614287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e56c58f3-4a1a-4b3c-8015-e72d2635999a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:44.630421 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:44.746883 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e56c58f3-4a1a-4b3c-8015-e72d2635999a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:44.754820 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e56c58f3-4a1a-4b3c-8015-e72d2635999a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1663 microversion: 2.1 time: 0.159011 Aug 30 01:14:44.762697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 301/586] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:44 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:44.762697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-033d8cf4-2e6d-42e4-ba2f-109857e4a8a9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:44.762697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-033d8cf4-2e6d-42e4-ba2f-109857e4a8a9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:44.767082 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-033d8cf4-2e6d-42e4-ba2f-109857e4a8a9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:44.767569 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-033d8cf4-2e6d-42e4-ba2f-109857e4a8a9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:44.768008 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-033d8cf4-2e6d-42e4-ba2f-109857e4a8a9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:44.768813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-033d8cf4-2e6d-42e4-ba2f-109857e4a8a9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:44.769278 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-033d8cf4-2e6d-42e4-ba2f-109857e4a8a9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:44.769706 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-033d8cf4-2e6d-42e4-ba2f-109857e4a8a9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:44.916914 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-033d8cf4-2e6d-42e4-ba2f-109857e4a8a9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:44.926431 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-033d8cf4-2e6d-42e4-ba2f-109857e4a8a9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1469 microversion: 2.1 time: 0.169613 Aug 30 01:14:44.927012 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 302/587] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:44 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1469 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:45.777074 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d6ab540d-bbc4-4a1d-9bd5-f7fe88773fdc tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:45.777717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d6ab540d-bbc4-4a1d-9bd5-f7fe88773fdc tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:45.784702 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d6ab540d-bbc4-4a1d-9bd5-f7fe88773fdc tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:45.785191 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d6ab540d-bbc4-4a1d-9bd5-f7fe88773fdc tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:45.785631 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d6ab540d-bbc4-4a1d-9bd5-f7fe88773fdc tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:45.786380 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d6ab540d-bbc4-4a1d-9bd5-f7fe88773fdc tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:45.786842 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d6ab540d-bbc4-4a1d-9bd5-f7fe88773fdc tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:45.787270 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d6ab540d-bbc4-4a1d-9bd5-f7fe88773fdc tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:45.918919 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d6ab540d-bbc4-4a1d-9bd5-f7fe88773fdc tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:45.926795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d6ab540d-bbc4-4a1d-9bd5-f7fe88773fdc tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1663 microversion: 2.1 time: 0.154830 Aug 30 01:14:45.927368 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 303/588] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:45 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:45.948096 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-fd8faf9a-fd18-463f-a5cf-993b0770a2c2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:45.948697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-fd8faf9a-fd18-463f-a5cf-993b0770a2c2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:45.954532 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fd8faf9a-fd18-463f-a5cf-993b0770a2c2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:45.955007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fd8faf9a-fd18-463f-a5cf-993b0770a2c2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:45.955433 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fd8faf9a-fd18-463f-a5cf-993b0770a2c2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:45.956110 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fd8faf9a-fd18-463f-a5cf-993b0770a2c2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:45.956587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fd8faf9a-fd18-463f-a5cf-993b0770a2c2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:45.957002 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fd8faf9a-fd18-463f-a5cf-993b0770a2c2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:46.085995 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-fd8faf9a-fd18-463f-a5cf-993b0770a2c2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:46.093861 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-fd8faf9a-fd18-463f-a5cf-993b0770a2c2 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1469 microversion: 2.1 time: 0.149600 Aug 30 01:14:46.094466 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 304/589] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:45 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1469 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:46.948193 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-905a3f7d-bd5c-4f6f-bec5-28959827f391 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:46.948831 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-905a3f7d-bd5c-4f6f-bec5-28959827f391 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:46.955301 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-905a3f7d-bd5c-4f6f-bec5-28959827f391 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:46.955791 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-905a3f7d-bd5c-4f6f-bec5-28959827f391 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:46.956228 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-905a3f7d-bd5c-4f6f-bec5-28959827f391 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:46.956921 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-905a3f7d-bd5c-4f6f-bec5-28959827f391 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:46.957378 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-905a3f7d-bd5c-4f6f-bec5-28959827f391 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:46.957832 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-905a3f7d-bd5c-4f6f-bec5-28959827f391 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:47.097502 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-905a3f7d-bd5c-4f6f-bec5-28959827f391 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:47.106673 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-905a3f7d-bd5c-4f6f-bec5-28959827f391 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1663 microversion: 2.1 time: 0.162300 Aug 30 01:14:47.107258 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 305/590] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:46 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:47.115145 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-db93e0a7-6e18-4762-a53f-ce413a2f151d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:47.115781 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-db93e0a7-6e18-4762-a53f-ce413a2f151d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:47.122267 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-db93e0a7-6e18-4762-a53f-ce413a2f151d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:47.122738 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-db93e0a7-6e18-4762-a53f-ce413a2f151d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:47.123174 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-db93e0a7-6e18-4762-a53f-ce413a2f151d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:47.123868 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-db93e0a7-6e18-4762-a53f-ce413a2f151d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:47.124326 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-db93e0a7-6e18-4762-a53f-ce413a2f151d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:47.124752 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-db93e0a7-6e18-4762-a53f-ce413a2f151d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:47.255548 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-db93e0a7-6e18-4762-a53f-ce413a2f151d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:47.264137 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-db93e0a7-6e18-4762-a53f-ce413a2f151d tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1469 microversion: 2.1 time: 0.152688 Aug 30 01:14:47.264720 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 306/591] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:47 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:47.320964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-35a9e0db-f1fa-419b-b4d2-7ab2be959fa6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:47.322069 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-35a9e0db-f1fa-419b-b4d2-7ab2be959fa6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:47.328059 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-35a9e0db-f1fa-419b-b4d2-7ab2be959fa6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:47.328539 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-35a9e0db-f1fa-419b-b4d2-7ab2be959fa6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:47.328975 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-35a9e0db-f1fa-419b-b4d2-7ab2be959fa6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:47.329665 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-35a9e0db-f1fa-419b-b4d2-7ab2be959fa6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:47.330147 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-35a9e0db-f1fa-419b-b4d2-7ab2be959fa6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:47.330571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-35a9e0db-f1fa-419b-b4d2-7ab2be959fa6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:47.354152 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-35a9e0db-f1fa-419b-b4d2-7ab2be959fa6 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1/ips" status: 200 len: 149 microversion: 2.1 time: 0.036850 Aug 30 01:14:47.354664 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 307/592] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 30 01:14:47 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:14:47.365512 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-55f6cd15-c5be-442a-8084-1f03afb2004f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8184703f-e584-47b6-9a3f-80ca49b4ac67"}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:14:47.368516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-55f6cd15-c5be-442a-8084-1f03afb2004f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:47.375133 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-55f6cd15-c5be-442a-8084-1f03afb2004f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:47.375618 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-55f6cd15-c5be-442a-8084-1f03afb2004f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:47.376056 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-55f6cd15-c5be-442a-8084-1f03afb2004f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:47.376754 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-55f6cd15-c5be-442a-8084-1f03afb2004f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:47.377449 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-55f6cd15-c5be-442a-8084-1f03afb2004f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:47.377637 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-55f6cd15-c5be-442a-8084-1f03afb2004f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:47.462158 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-55f6cd15-c5be-442a-8084-1f03afb2004f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] HTTP exception thrown: Invalid volume: volume 8184703f-e584-47b6-9a3f-80ca49b4ac67 is already attached to instances: aec6af1b-90af-41d0-9778-9c0d89e330bc Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-55f6cd15-c5be-442a-8084-1f03afb2004f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Request method failure captured: Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: POST /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1/os-volume_attachments HTTP/1.1 Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 74 Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOflXbDFJWgbl1TJC3Oy148qXhrnxQzWwozAEpLPUvBjkIue1CYn_oh9imGJ1y-bHs91DQfacqzNdoPNGJGBFUNkjPdHbXnb83IH3jbui9qUN0KpZ__R_CPwPnS8jDFUUiZ7g8Gk1RFVQFkhvoh-4PF9zh2BgfTwME3tmMd22zrKs0 Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:14:47.464554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:14:47.466304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:14:47.466304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:14:47.466304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:14:47.466304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:14:47.466304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:14:47.466304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:14:47.466304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:14:47.466304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 942d175e7e2742728e66fea84c851038 Aug 30 01:14:47.466304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:14:47.466304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Aug 30 01:14:47.466304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {"volumeAttachment": {"volumeId": "8184703f-e584-47b6-9a3f-80ca49b4ac67"}} Aug 30 01:14:47.466304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Invalid volume: volume 8184703f-e584-47b6-9a3f-80ca49b4ac67 is already attached to instances: aec6af1b-90af-41d0-9778-9c0d89e330bc Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'server_id': '8c8307f2-8199-4ffe-aa65-ab56d819f4a1', 'body': {'volumeAttachment': {'volumeId': '8184703f-e584-47b6-9a3f-80ca49b4ac67'}}} Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8184703f-e584-47b6-9a3f-80ca49b4ac67 is already attached to instances: aec6af1b-90af-41d0-9778-9c0d89e330bc Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:14:47.467170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8184703f-e584-47b6-9a3f-80ca49b4ac67 is already attached to instances: aec6af1b-90af-41d0-9778-9c0d89e330bc Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:14:47.468508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:14:47.469853 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:14:47.469853 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:14:47.469853 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:14:47.469853 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8184703f-e584-47b6-9a3f-80ca49b4ac67 is already attached to instances: aec6af1b-90af-41d0-9778-9c0d89e330bc Aug 30 01:14:47.469853 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:14:47.470186 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-55f6cd15-c5be-442a-8084-1f03afb2004f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Returning 400 to user: Invalid volume: volume 8184703f-e584-47b6-9a3f-80ca49b4ac67 is already attached to instances: aec6af1b-90af-41d0-9778-9c0d89e330bc {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:14:47.470953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-55f6cd15-c5be-442a-8084-1f03afb2004f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "POST /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109128 Aug 30 01:14:47.471539 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 308/593] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 30 01:14:47 2022] POST /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 01:14:47.480781 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a8f7bdff-78e6-4c54-bf91-e5d2b8f0db32 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:47.481270 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a8f7bdff-78e6-4c54-bf91-e5d2b8f0db32 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:47.487502 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a8f7bdff-78e6-4c54-bf91-e5d2b8f0db32 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:47.487982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a8f7bdff-78e6-4c54-bf91-e5d2b8f0db32 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:47.488412 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a8f7bdff-78e6-4c54-bf91-e5d2b8f0db32 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:47.489108 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a8f7bdff-78e6-4c54-bf91-e5d2b8f0db32 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:47.489560 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a8f7bdff-78e6-4c54-bf91-e5d2b8f0db32 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:47.490010 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a8f7bdff-78e6-4c54-bf91-e5d2b8f0db32 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:47.517208 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a8f7bdff-78e6-4c54-bf91-e5d2b8f0db32 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Going to try to terminate instance {{(pid=121233) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:14:47.779341 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a8f7bdff-78e6-4c54-bf91-e5d2b8f0db32 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 204 len: 0 microversion: 2.1 time: 0.302930 Aug 30 01:14:47.779942 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 309/594] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:14:47 2022] DELETE /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 01:14:47.788663 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-87e5cb46-f822-44ea-b78a-092381144543 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:47.789486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-87e5cb46-f822-44ea-b78a-092381144543 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:47.796804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87e5cb46-f822-44ea-b78a-092381144543 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:47.797358 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87e5cb46-f822-44ea-b78a-092381144543 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:47.797856 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87e5cb46-f822-44ea-b78a-092381144543 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:47.798526 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87e5cb46-f822-44ea-b78a-092381144543 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:47.798982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87e5cb46-f822-44ea-b78a-092381144543 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:47.799425 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87e5cb46-f822-44ea-b78a-092381144543 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:47.933506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-87e5cb46-f822-44ea-b78a-092381144543 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:47.941330 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-87e5cb46-f822-44ea-b78a-092381144543 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1681 microversion: 2.1 time: 0.156823 Aug 30 01:14:47.941919 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 310/595] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:47 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:48.127983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e78dbbcd-7c7c-4478-b605-acf4ccc2f3a4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:48.128656 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e78dbbcd-7c7c-4478-b605-acf4ccc2f3a4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:48.135877 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e78dbbcd-7c7c-4478-b605-acf4ccc2f3a4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:48.138205 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e78dbbcd-7c7c-4478-b605-acf4ccc2f3a4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:48.138205 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e78dbbcd-7c7c-4478-b605-acf4ccc2f3a4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:48.138205 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e78dbbcd-7c7c-4478-b605-acf4ccc2f3a4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:48.138700 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e78dbbcd-7c7c-4478-b605-acf4ccc2f3a4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:48.139170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e78dbbcd-7c7c-4478-b605-acf4ccc2f3a4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:48.267515 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e78dbbcd-7c7c-4478-b605-acf4ccc2f3a4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:48.275984 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e78dbbcd-7c7c-4478-b605-acf4ccc2f3a4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1663 microversion: 2.1 time: 0.152092 Aug 30 01:14:48.276549 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 311/596] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:48 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:48.285271 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4e574b13-949b-4f78-84ad-61bf23b77bbc tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:48.285910 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4e574b13-949b-4f78-84ad-61bf23b77bbc tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:48.291853 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4e574b13-949b-4f78-84ad-61bf23b77bbc tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:48.292340 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4e574b13-949b-4f78-84ad-61bf23b77bbc tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:48.292775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4e574b13-949b-4f78-84ad-61bf23b77bbc tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:48.293462 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4e574b13-949b-4f78-84ad-61bf23b77bbc tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:48.294210 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4e574b13-949b-4f78-84ad-61bf23b77bbc tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:48.294633 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4e574b13-949b-4f78-84ad-61bf23b77bbc tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:48.428928 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4e574b13-949b-4f78-84ad-61bf23b77bbc tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:48.437039 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4e574b13-949b-4f78-84ad-61bf23b77bbc tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1469 microversion: 2.1 time: 0.155483 Aug 30 01:14:48.437615 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 312/597] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:48 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:48.963884 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-402fbb12-ba1f-4474-913b-ddde2c60aad2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:48.964528 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-402fbb12-ba1f-4474-913b-ddde2c60aad2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:48.970747 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-402fbb12-ba1f-4474-913b-ddde2c60aad2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:48.971262 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-402fbb12-ba1f-4474-913b-ddde2c60aad2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:48.971694 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-402fbb12-ba1f-4474-913b-ddde2c60aad2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:48.972422 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-402fbb12-ba1f-4474-913b-ddde2c60aad2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:48.972896 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-402fbb12-ba1f-4474-913b-ddde2c60aad2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:48.973345 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-402fbb12-ba1f-4474-913b-ddde2c60aad2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:49.111045 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-402fbb12-ba1f-4474-913b-ddde2c60aad2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:49.119505 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-402fbb12-ba1f-4474-913b-ddde2c60aad2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1681 microversion: 2.1 time: 0.160247 Aug 30 01:14:49.127310 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 313/598] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:48 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:49.297846 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-86bcd4ee-8564-4bc5-887f-a37f9418233c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:49.305082 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-86bcd4ee-8564-4bc5-887f-a37f9418233c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:49.305082 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-86bcd4ee-8564-4bc5-887f-a37f9418233c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:49.305364 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-86bcd4ee-8564-4bc5-887f-a37f9418233c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:49.306432 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-86bcd4ee-8564-4bc5-887f-a37f9418233c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:49.307502 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-86bcd4ee-8564-4bc5-887f-a37f9418233c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:49.307964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-86bcd4ee-8564-4bc5-887f-a37f9418233c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:49.308392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-86bcd4ee-8564-4bc5-887f-a37f9418233c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:49.440499 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-86bcd4ee-8564-4bc5-887f-a37f9418233c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:49.449064 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-86bcd4ee-8564-4bc5-887f-a37f9418233c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1667 microversion: 2.1 time: 0.155714 Aug 30 01:14:49.449634 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 314/599] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:49 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:49.459852 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-88827682-5b39-4057-a0fc-b90f42678310 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:49.460463 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-88827682-5b39-4057-a0fc-b90f42678310 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:49.466650 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-88827682-5b39-4057-a0fc-b90f42678310 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:49.467139 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-88827682-5b39-4057-a0fc-b90f42678310 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:49.467649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-88827682-5b39-4057-a0fc-b90f42678310 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:49.468380 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-88827682-5b39-4057-a0fc-b90f42678310 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:49.468840 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-88827682-5b39-4057-a0fc-b90f42678310 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:49.469334 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-88827682-5b39-4057-a0fc-b90f42678310 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:49.601546 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-88827682-5b39-4057-a0fc-b90f42678310 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:49.610352 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-88827682-5b39-4057-a0fc-b90f42678310 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1469 microversion: 2.1 time: 0.154060 Aug 30 01:14:49.610926 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 315/600] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:49 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:50.140443 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-46c44094-6742-4d38-a609-3045e42b50e9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:50.141084 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-46c44094-6742-4d38-a609-3045e42b50e9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:50.147191 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-46c44094-6742-4d38-a609-3045e42b50e9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:50.147699 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-46c44094-6742-4d38-a609-3045e42b50e9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:50.148131 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-46c44094-6742-4d38-a609-3045e42b50e9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:50.148850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-46c44094-6742-4d38-a609-3045e42b50e9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:50.149304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-46c44094-6742-4d38-a609-3045e42b50e9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:50.150291 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-46c44094-6742-4d38-a609-3045e42b50e9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:50.281561 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-46c44094-6742-4d38-a609-3045e42b50e9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:50.285105 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:50.289882 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-46c44094-6742-4d38-a609-3045e42b50e9 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1681 microversion: 2.1 time: 0.153241 Aug 30 01:14:50.291057 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 316/601] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:50 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:50.634318 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a2d02b95-fc7e-4e76-b43c-a41c4b09781f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:50.635254 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a2d02b95-fc7e-4e76-b43c-a41c4b09781f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:50.649210 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2d02b95-fc7e-4e76-b43c-a41c4b09781f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:50.653151 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2d02b95-fc7e-4e76-b43c-a41c4b09781f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:50.653151 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2d02b95-fc7e-4e76-b43c-a41c4b09781f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:50.653151 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2d02b95-fc7e-4e76-b43c-a41c4b09781f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:50.653151 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2d02b95-fc7e-4e76-b43c-a41c4b09781f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:50.653541 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2d02b95-fc7e-4e76-b43c-a41c4b09781f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:50.794102 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a2d02b95-fc7e-4e76-b43c-a41c4b09781f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:50.802566 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a2d02b95-fc7e-4e76-b43c-a41c4b09781f tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1469 microversion: 2.1 time: 0.173124 Aug 30 01:14:50.803154 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 317/602] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:50 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1469 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:51.311403 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-427f502f-93c0-40d5-be23-3cfe85c4e08b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:51.312002 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-427f502f-93c0-40d5-be23-3cfe85c4e08b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:51.318152 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-427f502f-93c0-40d5-be23-3cfe85c4e08b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:51.318623 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-427f502f-93c0-40d5-be23-3cfe85c4e08b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:51.319052 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-427f502f-93c0-40d5-be23-3cfe85c4e08b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:51.319718 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-427f502f-93c0-40d5-be23-3cfe85c4e08b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:51.320164 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-427f502f-93c0-40d5-be23-3cfe85c4e08b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:51.320577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-427f502f-93c0-40d5-be23-3cfe85c4e08b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:51.452129 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-427f502f-93c0-40d5-be23-3cfe85c4e08b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:51.459917 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-427f502f-93c0-40d5-be23-3cfe85c4e08b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1681 microversion: 2.1 time: 0.152355 Aug 30 01:14:51.460475 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 318/603] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:51 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:51.828208 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-42b630e2-8cc8-4ec1-bd81-f25986d79fe9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:51.828911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-42b630e2-8cc8-4ec1-bd81-f25986d79fe9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:51.834741 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-42b630e2-8cc8-4ec1-bd81-f25986d79fe9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:51.835216 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-42b630e2-8cc8-4ec1-bd81-f25986d79fe9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:51.835652 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-42b630e2-8cc8-4ec1-bd81-f25986d79fe9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:51.836326 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-42b630e2-8cc8-4ec1-bd81-f25986d79fe9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:51.836771 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-42b630e2-8cc8-4ec1-bd81-f25986d79fe9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:51.837866 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-42b630e2-8cc8-4ec1-bd81-f25986d79fe9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:51.968236 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-42b630e2-8cc8-4ec1-bd81-f25986d79fe9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:51.975980 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-42b630e2-8cc8-4ec1-bd81-f25986d79fe9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1469 microversion: 2.1 time: 0.151744 Aug 30 01:14:51.976548 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 319/604] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:51 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:14:52.482614 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6579f23e-b0a6-4cdf-a93e-3d83b7ad00e3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:52.483206 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6579f23e-b0a6-4cdf-a93e-3d83b7ad00e3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:52.490014 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6579f23e-b0a6-4cdf-a93e-3d83b7ad00e3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:52.490498 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6579f23e-b0a6-4cdf-a93e-3d83b7ad00e3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:52.490940 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6579f23e-b0a6-4cdf-a93e-3d83b7ad00e3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:52.491628 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6579f23e-b0a6-4cdf-a93e-3d83b7ad00e3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:52.492080 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6579f23e-b0a6-4cdf-a93e-3d83b7ad00e3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:52.492502 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6579f23e-b0a6-4cdf-a93e-3d83b7ad00e3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:52.626066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6579f23e-b0a6-4cdf-a93e-3d83b7ad00e3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:52.634861 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6579f23e-b0a6-4cdf-a93e-3d83b7ad00e3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1681 microversion: 2.1 time: 0.155461 Aug 30 01:14:52.635675 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 320/605] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:52 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:52.997974 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-061d92e0-9872-4fbf-bc98-5621b4173af6 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:52.998601 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-061d92e0-9872-4fbf-bc98-5621b4173af6 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:53.004697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-061d92e0-9872-4fbf-bc98-5621b4173af6 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:53.005182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-061d92e0-9872-4fbf-bc98-5621b4173af6 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:53.006037 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-061d92e0-9872-4fbf-bc98-5621b4173af6 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:53.008254 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-061d92e0-9872-4fbf-bc98-5621b4173af6 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:53.008254 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-061d92e0-9872-4fbf-bc98-5621b4173af6 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:53.009449 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-061d92e0-9872-4fbf-bc98-5621b4173af6 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:53.143730 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-061d92e0-9872-4fbf-bc98-5621b4173af6 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:53.155967 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-061d92e0-9872-4fbf-bc98-5621b4173af6 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1469 microversion: 2.1 time: 0.161913 Aug 30 01:14:53.156917 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 321/606] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:52 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:53.230012 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5ceee977-b7db-472b-a0d1-f1aaf219288d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "POST /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.581435 Aug 30 01:14:53.230012 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 286/607] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 30 01:14:43 2022] POST /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-volume_attachments => generated 194 bytes in 9584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:14:53.292133 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-0dbe3ccb-1b86-4c3a-9280-0ddc145e9f49 req-0cee26ed-1057-4288-a67d-bce5ac33a5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf0e034-70be-4033-9fbf-6ae7f32c895e", "name": "network-vif-deleted", "tag": "c9469186-90f0-4715-85c3-8c8b2fd48e3c"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:14:53.338007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-0dbe3ccb-1b86-4c3a-9280-0ddc145e9f49 req-0cee26ed-1057-4288-a67d-bce5ac33a5c7 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:53.339114 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-0dbe3ccb-1b86-4c3a-9280-0ddc145e9f49 req-0cee26ed-1057-4288-a67d-bce5ac33a5c7 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:53.342411 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-0dbe3ccb-1b86-4c3a-9280-0ddc145e9f49 req-0cee26ed-1057-4288-a67d-bce5ac33a5c7 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:53.354767 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-0dbe3ccb-1b86-4c3a-9280-0ddc145e9f49 req-0cee26ed-1057-4288-a67d-bce5ac33a5c7 service nova] Creating event network-vif-deleted:c9469186-90f0-4715-85c3-8c8b2fd48e3c for instance 6cf0e034-70be-4033-9fbf-6ae7f32c895e on hv-cinder-81571 Aug 30 01:14:53.364075 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-0dbe3ccb-1b86-4c3a-9280-0ddc145e9f49 req-0cee26ed-1057-4288-a67d-bce5ac33a5c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079723 Aug 30 01:14:53.365207 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 322/608] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:14:53.658982 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4853ef16-7a6a-4222-883c-c25ec9531073 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:53.659688 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4853ef16-7a6a-4222-883c-c25ec9531073 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:53.669107 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=27 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:14:53.671700 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4853ef16-7a6a-4222-883c-c25ec9531073 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:53.672200 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4853ef16-7a6a-4222-883c-c25ec9531073 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:53.672637 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4853ef16-7a6a-4222-883c-c25ec9531073 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:53.673348 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4853ef16-7a6a-4222-883c-c25ec9531073 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:53.673883 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4853ef16-7a6a-4222-883c-c25ec9531073 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:53.674480 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4853ef16-7a6a-4222-883c-c25ec9531073 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:54.042449 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4853ef16-7a6a-4222-883c-c25ec9531073 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:54.053749 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4853ef16-7a6a-4222-883c-c25ec9531073 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1681 microversion: 2.1 time: 0.399745 Aug 30 01:14:54.064458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 287/609] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:53 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1681 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:54.180111 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-1cf203eb-66d6-4cea-8ea9-afc18492c26b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:54.182238 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-1cf203eb-66d6-4cea-8ea9-afc18492c26b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:54.189076 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1cf203eb-66d6-4cea-8ea9-afc18492c26b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:54.189939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1cf203eb-66d6-4cea-8ea9-afc18492c26b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:54.190598 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1cf203eb-66d6-4cea-8ea9-afc18492c26b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:54.191638 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1cf203eb-66d6-4cea-8ea9-afc18492c26b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:54.192199 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1cf203eb-66d6-4cea-8ea9-afc18492c26b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:54.192839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1cf203eb-66d6-4cea-8ea9-afc18492c26b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:54.236395 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1cf203eb-66d6-4cea-8ea9-afc18492c26b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:54.236882 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1cf203eb-66d6-4cea-8ea9-afc18492c26b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:54.237319 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1cf203eb-66d6-4cea-8ea9-afc18492c26b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:54.237790 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-1cf203eb-66d6-4cea-8ea9-afc18492c26b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lazy-loading 'fault' on Instance uuid 6cf0e034-70be-4033-9fbf-6ae7f32c895e {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:14:54.287230 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-1cf203eb-66d6-4cea-8ea9-afc18492c26b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e644ca2991040f8bb1c70599db0cb0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4cae65522c475fad31e57ae71c3c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:54.293752 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-1cf203eb-66d6-4cea-8ea9-afc18492c26b tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 200 len: 1303 microversion: 2.1 time: 0.118477 Aug 30 01:14:54.294344 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 323/610] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:54 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 1303 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:55.077297 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e507bfcb-2443-4597-a23f-b52b5114f153 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:55.078668 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e507bfcb-2443-4597-a23f-b52b5114f153 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:55.086638 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e507bfcb-2443-4597-a23f-b52b5114f153 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:55.087195 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e507bfcb-2443-4597-a23f-b52b5114f153 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:55.088437 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e507bfcb-2443-4597-a23f-b52b5114f153 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:55.088649 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e507bfcb-2443-4597-a23f-b52b5114f153 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:55.089113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e507bfcb-2443-4597-a23f-b52b5114f153 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:55.089543 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e507bfcb-2443-4597-a23f-b52b5114f153 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:55.169136 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e507bfcb-2443-4597-a23f-b52b5114f153 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:55.178802 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e507bfcb-2443-4597-a23f-b52b5114f153 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1614 microversion: 2.1 time: 0.105708 Aug 30 01:14:55.179390 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 288/611] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:55 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1614 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:55.316660 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-29a76873-29f4-4c26-ba5e-343c368870d9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:55.317324 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-29a76873-29f4-4c26-ba5e-343c368870d9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] [instance: 6cf0e034-70be-4033-9fbf-6ae7f32c895e] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:55.327430 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-29a76873-29f4-4c26-ba5e-343c368870d9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:55.327836 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-29a76873-29f4-4c26-ba5e-343c368870d9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:55.328275 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-29a76873-29f4-4c26-ba5e-343c368870d9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:55.328983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-29a76873-29f4-4c26-ba5e-343c368870d9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:55.329442 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-29a76873-29f4-4c26-ba5e-343c368870d9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:55.329896 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-29a76873-29f4-4c26-ba5e-343c368870d9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:55.346437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-29a76873-29f4-4c26-ba5e-343c368870d9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] HTTP exception thrown: Instance 6cf0e034-70be-4033-9fbf-6ae7f32c895e could not be found. Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-29a76873-29f4-4c26-ba5e-343c368870d9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Request method failure captured: Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e HTTP/1.1 Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWRvFpEf5mZLqIHXZlZ6ElLJwqiPed0v0DZQyVr8Mz48mz3WO01FvXyTKloR2FXHQ16zPVzxFG9zC0e1fEPHBcFQushVawS4ekG1HMrfrdbuq0t74duVyv8f1sC3GQ8vrR98mCW5Iy9naKH-CugBVJCyyQQ1ykR565Ex-gNMrfxdKN0 Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 1c4cae65522c475fad31e57ae71c3c5f Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-VolumesNegativeTest-633434944 Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:14:55.348157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:14:55.349682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1c4cae65522c475fad31e57ae71c3c5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1c4cae65522c475fad31e57ae71c3c5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1c4cae65522c475fad31e57ae71c3c5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1c4cae65522c475fad31e57ae71c3c5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:14:55.349682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-VolumesNegativeTest-633434944 Aug 30 01:14:55.349682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 1c4cae65522c475fad31e57ae71c3c5f Aug 30 01:14:55.349682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-VolumesNegativeTest-633434944 Aug 30 01:14:55.349682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-VolumesNegativeTest-633434944-project Aug 30 01:14:55.349682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:14:55.349682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:14:55.349682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 9e644ca2991040f8bb1c70599db0cb0f Aug 30 01:14:55.349682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-VolumesNegativeTest-633434944-project Aug 30 01:14:55.349682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:14:55.349682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance 6cf0e034-70be-4033-9fbf-6ae7f32c895e could not be found. Aug 30 01:14:55.349682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': '6cf0e034-70be-4033-9fbf-6ae7f32c895e'} Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf0e034-70be-4033-9fbf-6ae7f32c895e could not be found. Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:14:55.350597 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf0e034-70be-4033-9fbf-6ae7f32c895e could not be found. Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf0e034-70be-4033-9fbf-6ae7f32c895e could not be found. Aug 30 01:14:55.356299 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:14:55.357530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-29a76873-29f4-4c26-ba5e-343c368870d9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] Returning 404 to user: Instance 6cf0e034-70be-4033-9fbf-6ae7f32c895e could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:14:55.357530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-29a76873-29f4-4c26-ba5e-343c368870d9 tempest-VolumesNegativeTest-633434944 tempest-VolumesNegativeTest-633434944-project] 10.222.0.52 "GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e" status: 404 len: 111 microversion: 2.1 time: 0.038941 Aug 30 01:14:55.357530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 324/612] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:55 2022] GET /compute/v2.1/servers/6cf0e034-70be-4033-9fbf-6ae7f32c895e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:14:55.405921 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-920217ec-43df-4b66-ae5d-0426d5963af6 req-83a9b3eb-ea35-4d2c-9351-d03fd5079371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8307f2-8199-4ffe-aa65-ab56d819f4a1", "name": "network-vif-deleted", "tag": "2d5417df-fe2d-408c-83bc-53e948b0ec1f"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:14:55.421582 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-920217ec-43df-4b66-ae5d-0426d5963af6 req-83a9b3eb-ea35-4d2c-9351-d03fd5079371 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:55.422341 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-920217ec-43df-4b66-ae5d-0426d5963af6 req-83a9b3eb-ea35-4d2c-9351-d03fd5079371 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:55.422926 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-920217ec-43df-4b66-ae5d-0426d5963af6 req-83a9b3eb-ea35-4d2c-9351-d03fd5079371 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:55.447206 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-920217ec-43df-4b66-ae5d-0426d5963af6 req-83a9b3eb-ea35-4d2c-9351-d03fd5079371 service nova] Creating event network-vif-deleted:2d5417df-fe2d-408c-83bc-53e948b0ec1f for instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 on hv-cinder-81571 Aug 30 01:14:55.462677 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-920217ec-43df-4b66-ae5d-0426d5963af6 req-83a9b3eb-ea35-4d2c-9351-d03fd5079371 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063145 Aug 30 01:14:55.463165 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 289/613] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:14:56.202170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9676cef6-e73e-491b-85ea-e34bc474d5c0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:56.202780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9676cef6-e73e-491b-85ea-e34bc474d5c0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:56.209320 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9676cef6-e73e-491b-85ea-e34bc474d5c0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:56.210066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9676cef6-e73e-491b-85ea-e34bc474d5c0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:56.210514 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9676cef6-e73e-491b-85ea-e34bc474d5c0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:56.211354 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9676cef6-e73e-491b-85ea-e34bc474d5c0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:56.212095 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9676cef6-e73e-491b-85ea-e34bc474d5c0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:56.212868 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9676cef6-e73e-491b-85ea-e34bc474d5c0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:56.249529 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9676cef6-e73e-491b-85ea-e34bc474d5c0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:56.250071 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9676cef6-e73e-491b-85ea-e34bc474d5c0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:56.250519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9676cef6-e73e-491b-85ea-e34bc474d5c0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:56.250986 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-9676cef6-e73e-491b-85ea-e34bc474d5c0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lazy-loading 'fault' on Instance uuid 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:14:56.293166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9676cef6-e73e-491b-85ea-e34bc474d5c0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:14:56.301761 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9676cef6-e73e-491b-85ea-e34bc474d5c0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 200 len: 1332 microversion: 2.1 time: 0.103420 Aug 30 01:14:56.302344 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 325/614] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:56 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:14:57.325984 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a5d33ab1-67dc-4a23-a5c6-386af511b824 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:57.326682 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a5d33ab1-67dc-4a23-a5c6-386af511b824 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:57.332866 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5d33ab1-67dc-4a23-a5c6-386af511b824 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:57.333340 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5d33ab1-67dc-4a23-a5c6-386af511b824 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:57.333813 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5d33ab1-67dc-4a23-a5c6-386af511b824 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:57.334504 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5d33ab1-67dc-4a23-a5c6-386af511b824 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:57.338218 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5d33ab1-67dc-4a23-a5c6-386af511b824 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:57.338218 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a5d33ab1-67dc-4a23-a5c6-386af511b824 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:57.351264 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-a5d33ab1-67dc-4a23-a5c6-386af511b824 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] HTTP exception thrown: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a5d33ab1-67dc-4a23-a5c6-386af511b824 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Request method failure captured: Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 HTTP/1.1 Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWOflXbDFJWgbl1TJC3Oy148qXhrnxQzWwozAEpLPUvBjkIue1CYn_oh9imGJ1y-bHs91DQfacqzNdoPNGJGBFUNkjPdHbXnb83IH3jbui9qUN0KpZ__R_CPwPnS8jDFUUiZ7g8Gk1RFVQFkhvoh-4PF9zh2BgfTwME3tmMd22zrKs0 Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:14:57.353024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:14:57.354576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:14:57.354576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:14:57.354576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:14:57.354576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:14:57.354576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:14:57.354576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:14:57.354576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:14:57.354576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 942d175e7e2742728e66fea84c851038 Aug 30 01:14:57.354576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:14:57.354576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:14:57.354576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. Aug 30 01:14:57.354576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': '8c8307f2-8199-4ffe-aa65-ab56d819f4a1'} Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:14:57.355409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. Aug 30 01:14:57.356746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:14:57.358083 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a5d33ab1-67dc-4a23-a5c6-386af511b824 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Returning 404 to user: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:14:57.358083 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a5d33ab1-67dc-4a23-a5c6-386af511b824 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 404 len: 111 microversion: 2.1 time: 0.033957 Aug 30 01:14:57.358083 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 290/615] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:14:57 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:14:57.364097 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6ac8c751-4a80-43d7-a345-2bff8ee76c94 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '.version_select at 0x7fd71d040280>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:57.466986 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6ac8c751-4a80-43d7-a345-2bff8ee76c94 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063945513" status: 202 len: 0 microversion: 2.1 time: 0.106872 Aug 30 01:14:57.467492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 326/616] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Aug 30 01:14:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063945513 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:14:58.342639 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a6dbb43b-234c-40e0-bd12-892733ca4370 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:58.343239 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a6dbb43b-234c-40e0-bd12-892733ca4370 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:58.349781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6dbb43b-234c-40e0-bd12-892733ca4370 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:58.350268 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6dbb43b-234c-40e0-bd12-892733ca4370 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:58.350706 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6dbb43b-234c-40e0-bd12-892733ca4370 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:58.351396 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6dbb43b-234c-40e0-bd12-892733ca4370 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:58.351845 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6dbb43b-234c-40e0-bd12-892733ca4370 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:58.352268 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6dbb43b-234c-40e0-bd12-892733ca4370 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:58.483917 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-a6dbb43b-234c-40e0-bd12-892733ca4370 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lazy-loading 'services' on Instance uuid aec6af1b-90af-41d0-9778-9c0d89e330bc {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:14:58.755733 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a6dbb43b-234c-40e0-bd12-892733ca4370 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/os-volume_attachments/8184703f-e584-47b6-9a3f-80ca49b4ac67" status: 202 len: 0 microversion: 2.1 time: 0.417041 Aug 30 01:14:58.756323 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 291/617] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 30 01:14:58 2022] DELETE /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/os-volume_attachments/8184703f-e584-47b6-9a3f-80ca49b4ac67 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:14:58.766276 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-34ccb54a-0459-43f9-af5d-45d6020ee0d5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:58.768483 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-34ccb54a-0459-43f9-af5d-45d6020ee0d5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:58.775481 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34ccb54a-0459-43f9-af5d-45d6020ee0d5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:58.776002 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34ccb54a-0459-43f9-af5d-45d6020ee0d5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:58.776431 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34ccb54a-0459-43f9-af5d-45d6020ee0d5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:58.777120 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34ccb54a-0459-43f9-af5d-45d6020ee0d5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:58.777565 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34ccb54a-0459-43f9-af5d-45d6020ee0d5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:58.778009 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34ccb54a-0459-43f9-af5d-45d6020ee0d5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:58.808440 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-34ccb54a-0459-43f9-af5d-45d6020ee0d5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046723 Aug 30 01:14:58.809003 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 327/618] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:14:58 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:14:59.826324 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7aa33e83-09cc-470e-8b91-c5f81eee7866 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:14:59.832814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7aa33e83-09cc-470e-8b91-c5f81eee7866 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:14:59.846958 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7aa33e83-09cc-470e-8b91-c5f81eee7866 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:59.847657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7aa33e83-09cc-470e-8b91-c5f81eee7866 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:59.848562 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7aa33e83-09cc-470e-8b91-c5f81eee7866 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:59.849431 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7aa33e83-09cc-470e-8b91-c5f81eee7866 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:14:59.850690 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7aa33e83-09cc-470e-8b91-c5f81eee7866 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:14:59.851439 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7aa33e83-09cc-470e-8b91-c5f81eee7866 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:14:59.890287 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7aa33e83-09cc-470e-8b91-c5f81eee7866 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071738 Aug 30 01:14:59.895819 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 292/619] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:14:59 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:00.903099 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-743c8e46-ad22-4ebd-8128-b9e83eb1df18 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:00.905233 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-743c8e46-ad22-4ebd-8128-b9e83eb1df18 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:00.911922 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-743c8e46-ad22-4ebd-8128-b9e83eb1df18 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:00.912407 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-743c8e46-ad22-4ebd-8128-b9e83eb1df18 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:00.912849 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-743c8e46-ad22-4ebd-8128-b9e83eb1df18 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:00.913545 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-743c8e46-ad22-4ebd-8128-b9e83eb1df18 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:00.914085 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-743c8e46-ad22-4ebd-8128-b9e83eb1df18 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:00.914519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-743c8e46-ad22-4ebd-8128-b9e83eb1df18 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:00.947679 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-743c8e46-ad22-4ebd-8128-b9e83eb1df18 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048720 Aug 30 01:15:00.948305 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 328/620] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:15:00 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:01.959819 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-456bd3b3-2233-4880-96e7-b3c0435b7f33 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:01.962349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-456bd3b3-2233-4880-96e7-b3c0435b7f33 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:01.968899 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-456bd3b3-2233-4880-96e7-b3c0435b7f33 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:01.969458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-456bd3b3-2233-4880-96e7-b3c0435b7f33 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:01.972244 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-456bd3b3-2233-4880-96e7-b3c0435b7f33 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:01.972244 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-456bd3b3-2233-4880-96e7-b3c0435b7f33 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:01.972244 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-456bd3b3-2233-4880-96e7-b3c0435b7f33 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:01.972244 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-456bd3b3-2233-4880-96e7-b3c0435b7f33 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:02.005073 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-456bd3b3-2233-4880-96e7-b3c0435b7f33 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049381 Aug 30 01:15:02.005659 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 293/621] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:15:01 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:02.103726 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9d51dca5-d4aa-4470-ac4d-c917442c6704 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:02.105937 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9d51dca5-d4aa-4470-ac4d-c917442c6704 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:02.112658 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d51dca5-d4aa-4470-ac4d-c917442c6704 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:02.113143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d51dca5-d4aa-4470-ac4d-c917442c6704 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:02.113578 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d51dca5-d4aa-4470-ac4d-c917442c6704 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:02.114306 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d51dca5-d4aa-4470-ac4d-c917442c6704 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:02.121806 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d51dca5-d4aa-4470-ac4d-c917442c6704 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:02.121806 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d51dca5-d4aa-4470-ac4d-c917442c6704 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:02.141301 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-9d51dca5-d4aa-4470-ac4d-c917442c6704 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lazy-loading 'flavor' on Instance uuid 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:15:02.425038 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9d51dca5-d4aa-4470-ac4d-c917442c6704 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "POST /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/action" status: 200 len: 32 microversion: 2.1 time: 0.324802 Aug 30 01:15:02.425657 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 329/622] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 30 01:15:02 2022] POST /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/action => generated 32 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:15:02.436932 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e68e59c5-6b28-4cb3-a35d-fb3b0c7d8d83 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:02.437541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e68e59c5-6b28-4cb3-a35d-fb3b0c7d8d83 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:02.443849 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e68e59c5-6b28-4cb3-a35d-fb3b0c7d8d83 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:02.455118 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e68e59c5-6b28-4cb3-a35d-fb3b0c7d8d83 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:02.455118 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e68e59c5-6b28-4cb3-a35d-fb3b0c7d8d83 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:02.455118 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e68e59c5-6b28-4cb3-a35d-fb3b0c7d8d83 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:02.455118 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e68e59c5-6b28-4cb3-a35d-fb3b0c7d8d83 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:02.455608 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e68e59c5-6b28-4cb3-a35d-fb3b0c7d8d83 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:02.625871 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e68e59c5-6b28-4cb3-a35d-fb3b0c7d8d83 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:02.634510 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e68e59c5-6b28-4cb3-a35d-fb3b0c7d8d83 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.201378 Aug 30 01:15:02.635149 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 294/623] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:02 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:03.018717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0dd8cf23-a5dd-4807-ab03-768b930cf5fa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:03.021168 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0dd8cf23-a5dd-4807-ab03-768b930cf5fa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:03.023519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:03.028621 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0dd8cf23-a5dd-4807-ab03-768b930cf5fa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:03.029104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0dd8cf23-a5dd-4807-ab03-768b930cf5fa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:03.029542 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0dd8cf23-a5dd-4807-ab03-768b930cf5fa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:03.030267 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0dd8cf23-a5dd-4807-ab03-768b930cf5fa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:03.030725 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0dd8cf23-a5dd-4807-ab03-768b930cf5fa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:03.031152 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0dd8cf23-a5dd-4807-ab03-768b930cf5fa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:03.067638 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0dd8cf23-a5dd-4807-ab03-768b930cf5fa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053064 Aug 30 01:15:03.068943 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 330/624] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:15:03 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:15:03.140866 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-960080e3-da78-4f5d-93d3-223d00dfaf8d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:03.141466 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-960080e3-da78-4f5d-93d3-223d00dfaf8d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:03.148080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-960080e3-da78-4f5d-93d3-223d00dfaf8d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:03.148626 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-960080e3-da78-4f5d-93d3-223d00dfaf8d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:03.149063 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-960080e3-da78-4f5d-93d3-223d00dfaf8d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:03.149811 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-960080e3-da78-4f5d-93d3-223d00dfaf8d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:03.150447 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-960080e3-da78-4f5d-93d3-223d00dfaf8d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:03.150870 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-960080e3-da78-4f5d-93d3-223d00dfaf8d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:03.182443 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-960080e3-da78-4f5d-93d3-223d00dfaf8d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:15:03.217443 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:03.489845 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-960080e3-da78-4f5d-93d3-223d00dfaf8d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 204 len: 0 microversion: 2.1 time: 0.352412 Aug 30 01:15:03.490557 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 295/625] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:15:03 2022] DELETE /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:03.499240 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-55b788b7-8592-421e-a70e-140775f03621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:03.499886 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-55b788b7-8592-421e-a70e-140775f03621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:03.506504 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-55b788b7-8592-421e-a70e-140775f03621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:03.506993 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-55b788b7-8592-421e-a70e-140775f03621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:03.507424 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-55b788b7-8592-421e-a70e-140775f03621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:03.508117 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-55b788b7-8592-421e-a70e-140775f03621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:03.508572 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-55b788b7-8592-421e-a70e-140775f03621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:03.508996 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-55b788b7-8592-421e-a70e-140775f03621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:03.658031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-46352269-fe95-4545-88e6-cf8f9d01e603 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:03.658758 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-46352269-fe95-4545-88e6-cf8f9d01e603 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:03.666515 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46352269-fe95-4545-88e6-cf8f9d01e603 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:03.666913 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46352269-fe95-4545-88e6-cf8f9d01e603 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:03.667766 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46352269-fe95-4545-88e6-cf8f9d01e603 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:03.668869 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46352269-fe95-4545-88e6-cf8f9d01e603 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:03.669337 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46352269-fe95-4545-88e6-cf8f9d01e603 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:03.669790 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46352269-fe95-4545-88e6-cf8f9d01e603 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:03.671997 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-55b788b7-8592-421e-a70e-140775f03621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:03.681683 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-55b788b7-8592-421e-a70e-140775f03621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1680 microversion: 2.1 time: 0.186554 Aug 30 01:15:03.682978 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 331/626] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:03 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:03.820698 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-46352269-fe95-4545-88e6-cf8f9d01e603 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:03.830135 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-46352269-fe95-4545-88e6-cf8f9d01e603 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.176780 Aug 30 01:15:03.830722 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 296/627] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:03 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:04.705254 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-025e1ee7-6df5-41d9-9747-10210aa43ad5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:04.706297 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-025e1ee7-6df5-41d9-9747-10210aa43ad5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:04.713813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-025e1ee7-6df5-41d9-9747-10210aa43ad5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:04.714370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-025e1ee7-6df5-41d9-9747-10210aa43ad5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:04.714915 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-025e1ee7-6df5-41d9-9747-10210aa43ad5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:04.715734 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-025e1ee7-6df5-41d9-9747-10210aa43ad5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:04.716416 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-025e1ee7-6df5-41d9-9747-10210aa43ad5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:04.716951 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-025e1ee7-6df5-41d9-9747-10210aa43ad5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:04.853893 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cddf3eee-4ed1-45a8-816e-332db57754bc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:04.855245 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cddf3eee-4ed1-45a8-816e-332db57754bc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:04.861667 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cddf3eee-4ed1-45a8-816e-332db57754bc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:04.862225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cddf3eee-4ed1-45a8-816e-332db57754bc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:04.862665 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cddf3eee-4ed1-45a8-816e-332db57754bc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:04.863371 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cddf3eee-4ed1-45a8-816e-332db57754bc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:04.863856 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cddf3eee-4ed1-45a8-816e-332db57754bc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:04.864479 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cddf3eee-4ed1-45a8-816e-332db57754bc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:04.900855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-025e1ee7-6df5-41d9-9747-10210aa43ad5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:04.910182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-025e1ee7-6df5-41d9-9747-10210aa43ad5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1680 microversion: 2.1 time: 0.209252 Aug 30 01:15:04.911018 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 332/628] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:04 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1680 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:05.024597 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cddf3eee-4ed1-45a8-816e-332db57754bc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:05.038933 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cddf3eee-4ed1-45a8-816e-332db57754bc tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.190631 Aug 30 01:15:05.039520 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 297/629] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:04 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:05.932531 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-317b82d1-2abc-48ad-9c81-09c0ef78516f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:05.933138 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-317b82d1-2abc-48ad-9c81-09c0ef78516f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:05.939534 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-317b82d1-2abc-48ad-9c81-09c0ef78516f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:05.940013 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-317b82d1-2abc-48ad-9c81-09c0ef78516f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:05.940440 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-317b82d1-2abc-48ad-9c81-09c0ef78516f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:05.941123 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-317b82d1-2abc-48ad-9c81-09c0ef78516f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:05.942202 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-317b82d1-2abc-48ad-9c81-09c0ef78516f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:05.942202 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-317b82d1-2abc-48ad-9c81-09c0ef78516f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:05.947293 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:06.064311 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-57dc7e4a-72a7-4e5e-8849-fdcbe5ca71a4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:06.067523 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-57dc7e4a-72a7-4e5e-8849-fdcbe5ca71a4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:06.077905 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57dc7e4a-72a7-4e5e-8849-fdcbe5ca71a4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:06.078667 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57dc7e4a-72a7-4e5e-8849-fdcbe5ca71a4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:06.080001 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57dc7e4a-72a7-4e5e-8849-fdcbe5ca71a4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:06.080736 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57dc7e4a-72a7-4e5e-8849-fdcbe5ca71a4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:06.081194 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57dc7e4a-72a7-4e5e-8849-fdcbe5ca71a4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:06.081615 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57dc7e4a-72a7-4e5e-8849-fdcbe5ca71a4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:06.405020 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-57dc7e4a-72a7-4e5e-8849-fdcbe5ca71a4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:06.408941 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-317b82d1-2abc-48ad-9c81-09c0ef78516f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:06.414659 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-57dc7e4a-72a7-4e5e-8849-fdcbe5ca71a4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.355129 Aug 30 01:15:06.415740 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 298/630] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:06 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:06.417151 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-317b82d1-2abc-48ad-9c81-09c0ef78516f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1680 microversion: 2.1 time: 0.488443 Aug 30 01:15:06.417750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 333/631] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:05 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1680 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:06.844913 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-c41af652-6caf-4c74-914c-e5bc25296938 req-2e174466-2f7f-4bd2-b248-616ca66a20f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec6af1b-90af-41d0-9778-9c0d89e330bc", "name": "network-vif-deleted", "tag": "66ac913d-aad3-451a-96e1-8f106967b9a5"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:06.855073 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c41af652-6caf-4c74-914c-e5bc25296938 req-2e174466-2f7f-4bd2-b248-616ca66a20f3 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:06.855571 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c41af652-6caf-4c74-914c-e5bc25296938 req-2e174466-2f7f-4bd2-b248-616ca66a20f3 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:06.855980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c41af652-6caf-4c74-914c-e5bc25296938 req-2e174466-2f7f-4bd2-b248-616ca66a20f3 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:06.867377 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-c41af652-6caf-4c74-914c-e5bc25296938 req-2e174466-2f7f-4bd2-b248-616ca66a20f3 service nova] Creating event network-vif-deleted:66ac913d-aad3-451a-96e1-8f106967b9a5 for instance aec6af1b-90af-41d0-9778-9c0d89e330bc on hv-cinder-81571 Aug 30 01:15:06.874972 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-c41af652-6caf-4c74-914c-e5bc25296938 req-2e174466-2f7f-4bd2-b248-616ca66a20f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033466 Aug 30 01:15:06.875896 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 299/632] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:07.440289 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-34fefbf6-33a9-4d6b-ae11-0e062b854a34 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:07.441518 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f5988067-b89b-4270-98ec-3e95c60f2814 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:07.442026 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-34fefbf6-33a9-4d6b-ae11-0e062b854a34 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:07.442245 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f5988067-b89b-4270-98ec-3e95c60f2814 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:07.453691 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5988067-b89b-4270-98ec-3e95c60f2814 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:07.454257 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5988067-b89b-4270-98ec-3e95c60f2814 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:07.454702 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5988067-b89b-4270-98ec-3e95c60f2814 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:07.455363 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34fefbf6-33a9-4d6b-ae11-0e062b854a34 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:07.455485 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5988067-b89b-4270-98ec-3e95c60f2814 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:07.455864 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5988067-b89b-4270-98ec-3e95c60f2814 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:07.456293 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5988067-b89b-4270-98ec-3e95c60f2814 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:07.456590 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34fefbf6-33a9-4d6b-ae11-0e062b854a34 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:07.459301 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34fefbf6-33a9-4d6b-ae11-0e062b854a34 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:07.460577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34fefbf6-33a9-4d6b-ae11-0e062b854a34 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:07.463590 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34fefbf6-33a9-4d6b-ae11-0e062b854a34 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:07.465059 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-34fefbf6-33a9-4d6b-ae11-0e062b854a34 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:07.536216 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5988067-b89b-4270-98ec-3e95c60f2814 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:07.536752 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5988067-b89b-4270-98ec-3e95c60f2814 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:07.537192 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f5988067-b89b-4270-98ec-3e95c60f2814 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:07.537638 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-f5988067-b89b-4270-98ec-3e95c60f2814 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lazy-loading 'fault' on Instance uuid aec6af1b-90af-41d0-9778-9c0d89e330bc {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:15:07.630688 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f5988067-b89b-4270-98ec-3e95c60f2814 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:07.639815 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f5988067-b89b-4270-98ec-3e95c60f2814 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 200 len: 1330 microversion: 2.1 time: 0.202058 Aug 30 01:15:07.642560 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 300/633] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:07 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 1330 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:07.676825 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-34fefbf6-33a9-4d6b-ae11-0e062b854a34 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:07.687940 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-34fefbf6-33a9-4d6b-ae11-0e062b854a34 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.251593 Aug 30 01:15:07.689251 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 334/634] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:07 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:08.668995 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-aeb444c9-b8b7-4d14-9e1e-1ba9d9e30117 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:08.670405 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-aeb444c9-b8b7-4d14-9e1e-1ba9d9e30117 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:08.686861 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aeb444c9-b8b7-4d14-9e1e-1ba9d9e30117 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:08.687782 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aeb444c9-b8b7-4d14-9e1e-1ba9d9e30117 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:08.689014 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aeb444c9-b8b7-4d14-9e1e-1ba9d9e30117 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:08.689833 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aeb444c9-b8b7-4d14-9e1e-1ba9d9e30117 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:08.690371 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aeb444c9-b8b7-4d14-9e1e-1ba9d9e30117 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:08.691615 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aeb444c9-b8b7-4d14-9e1e-1ba9d9e30117 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:08.710716 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9e63cef5-ad16-4e55-b3d5-4638647d873d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:08.712051 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9e63cef5-ad16-4e55-b3d5-4638647d873d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:08.718549 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9e63cef5-ad16-4e55-b3d5-4638647d873d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:08.722223 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-aeb444c9-b8b7-4d14-9e1e-1ba9d9e30117 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] HTTP exception thrown: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. Aug 30 01:15:08.722954 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9e63cef5-ad16-4e55-b3d5-4638647d873d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:08.723610 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9e63cef5-ad16-4e55-b3d5-4638647d873d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:08.724325 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9e63cef5-ad16-4e55-b3d5-4638647d873d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-aeb444c9-b8b7-4d14-9e1e-1ba9d9e30117 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Request method failure captured: Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc HTTP/1.1 Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWOflXbDFJWgbl1TJC3Oy148qXhrnxQzWwozAEpLPUvBjkIue1CYn_oh9imGJ1y-bHs91DQfacqzNdoPNGJGBFUNkjPdHbXnb83IH3jbui9qUN0KpZ__R_CPwPnS8jDFUUiZ7g8Gk1RFVQFkhvoh-4PF9zh2BgfTwME3tmMd22zrKs0 Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:15:08.726213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:15:08.727508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:15:08.727508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:15:08.727508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:15:08.727508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:15:08.727508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:15:08.727508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:15:08.727508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:15:08.727508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 942d175e7e2742728e66fea84c851038 Aug 30 01:15:08.727508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:15:08.727508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:15:08.727508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. Aug 30 01:15:08.727508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': 'aec6af1b-90af-41d0-9778-9c0d89e330bc'} Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:15:08.728763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. Aug 30 01:15:08.729938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:15:08.732427 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9e63cef5-ad16-4e55-b3d5-4638647d873d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:08.733096 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9e63cef5-ad16-4e55-b3d5-4638647d873d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:08.734161 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-aeb444c9-b8b7-4d14-9e1e-1ba9d9e30117 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Returning 404 to user: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:15:08.739677 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-aeb444c9-b8b7-4d14-9e1e-1ba9d9e30117 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 404 len: 111 microversion: 2.1 time: 0.079046 Aug 30 01:15:08.740243 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 301/635] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:08 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:15:08.750515 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e3593d0c-c6bf-4ac8-9925-16e1f493044b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '.version_select at 0x7fd71cf9a8b0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:08.886738 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9e63cef5-ad16-4e55-b3d5-4638647d873d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:08.895492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9e63cef5-ad16-4e55-b3d5-4638647d873d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.188395 Aug 30 01:15:08.896023 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 335/636] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:08 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:08.913059 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e3593d0c-c6bf-4ac8-9925-16e1f493044b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-521380224" status: 202 len: 0 microversion: 2.1 time: 0.165664 Aug 30 01:15:08.914032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 302/637] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Aug 30 01:15:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-521380224 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:15:09.831935 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-bacc18bc-2ea9-40fd-b2cd-47431b0d3a1e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Action: 'create', calling method: .version_select at 0x7fd71ce79af0>, body: {"keypair": {"name": "tempest-keypair-1712190695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7nDP9N/+N7p4yOqmgPhSJKsit1O5wopwQ9KZ4OSiJ/34t9DY7d8ivkoTFP0THu0ciVOIRodSnKR2bXhW0bIR76rbJXiVLi3TCx8kane1evxABSt8PeKFC81CUlcE+/zQ=="}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:09.848505 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-bacc18bc-2ea9-40fd-b2cd-47431b0d3a1e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Getting quotas for project 11c8f48af7394a75ab6013ca066751a7. Resources: {'key_pairs'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:15:09.852459 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-bacc18bc-2ea9-40fd-b2cd-47431b0d3a1e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Getting quotas for user 942d175e7e2742728e66fea84c851038 and project 11c8f48af7394a75ab6013ca066751a7. Resources: {'key_pairs'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:15:09.924541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-10b8da75-efc7-4a16-b637-157d49bc254e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:09.924541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-10b8da75-efc7-4a16-b637-157d49bc254e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:09.926983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10b8da75-efc7-4a16-b637-157d49bc254e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:09.927493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10b8da75-efc7-4a16-b637-157d49bc254e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:09.927910 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10b8da75-efc7-4a16-b637-157d49bc254e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:09.929319 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10b8da75-efc7-4a16-b637-157d49bc254e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:09.929805 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10b8da75-efc7-4a16-b637-157d49bc254e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:09.930233 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10b8da75-efc7-4a16-b637-157d49bc254e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:09.974467 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-bacc18bc-2ea9-40fd-b2cd-47431b0d3a1e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.146414 Aug 30 01:15:09.975434 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 336/638] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 30 01:15:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:10.070627 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-10b8da75-efc7-4a16-b637-157d49bc254e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:10.079154 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-10b8da75-efc7-4a16-b637-157d49bc254e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.166422 Aug 30 01:15:10.079735 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 303/639] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:09 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:11.101303 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d931f6e5-d7b5-48ff-a884-30d5c27899e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:11.102310 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d931f6e5-d7b5-48ff-a884-30d5c27899e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:11.111348 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d931f6e5-d7b5-48ff-a884-30d5c27899e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:11.112036 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d931f6e5-d7b5-48ff-a884-30d5c27899e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:11.112565 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d931f6e5-d7b5-48ff-a884-30d5c27899e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:11.113641 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d931f6e5-d7b5-48ff-a884-30d5c27899e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:11.114232 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d931f6e5-d7b5-48ff-a884-30d5c27899e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:11.114647 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d931f6e5-d7b5-48ff-a884-30d5c27899e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:11.264758 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d931f6e5-d7b5-48ff-a884-30d5c27899e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:11.274411 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d931f6e5-d7b5-48ff-a884-30d5c27899e4 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.177870 Aug 30 01:15:11.275333 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 337/640] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:11 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:12.296707 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f7ee658f-8582-4c53-9973-a15c42952f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:12.297896 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f7ee658f-8582-4c53-9973-a15c42952f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:12.308328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7ee658f-8582-4c53-9973-a15c42952f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:12.311686 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7ee658f-8582-4c53-9973-a15c42952f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:12.311686 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7ee658f-8582-4c53-9973-a15c42952f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:12.311686 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7ee658f-8582-4c53-9973-a15c42952f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:12.311686 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7ee658f-8582-4c53-9973-a15c42952f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:12.312069 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f7ee658f-8582-4c53-9973-a15c42952f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:12.974993 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f7ee658f-8582-4c53-9973-a15c42952f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:12.985523 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f7ee658f-8582-4c53-9973-a15c42952f16 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.692771 Aug 30 01:15:12.986146 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 304/641] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:12 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:13.271591 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-595122879", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "281ceb28-999a-45ac-8b94-e3a5aba703ca"}], "security_groups": [{"name": "tempest-securitygroup--206719634"}], "key_name": "tempest-keypair-1712190695", "user_data": "}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:13.408243 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.network.neutron [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] validate_networks() for [('281ceb28-999a-45ac-8b94-e3a5aba703ca', None, None, None, None, None)] {{(pid=121233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:15:13.865473 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Flavor limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:15:13.866309 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Image limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:15:13.866791 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Flavor pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:15:13.867201 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Image pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:15:13.867784 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:15:13.878967 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:13.879804 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:13.880245 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:13.880983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:13.881442 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:13.881912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:13.902968 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Getting quotas for project 11c8f48af7394a75ab6013ca066751a7. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:15:13.909188 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Getting quotas for user 942d175e7e2742728e66fea84c851038 and project 11c8f48af7394a75ab6013ca066751a7. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:15:13.923610 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Going to run 1 instances... {{(pid=121233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:15:13.927744 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:15:14.012678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-17c9dd36-0658-4d0c-ae7c-a67f4f173ff1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:14.013618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-17c9dd36-0658-4d0c-ae7c-a67f4f173ff1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:14.020655 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17c9dd36-0658-4d0c-ae7c-a67f4f173ff1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:14.021605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17c9dd36-0658-4d0c-ae7c-a67f4f173ff1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:14.021605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17c9dd36-0658-4d0c-ae7c-a67f4f173ff1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:14.022311 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17c9dd36-0658-4d0c-ae7c-a67f4f173ff1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:14.022775 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17c9dd36-0658-4d0c-ae7c-a67f4f173ff1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:14.023200 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17c9dd36-0658-4d0c-ae7c-a67f4f173ff1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:14.058791 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-10851229-19d4-4331-94b6-abb59740a27e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.792247 Aug 30 01:15:14.059448 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 338/642] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:15:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:15:14.076523 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4d2e0ea4-d1d5-4e88-924e-be6d5f0ad9af tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:14.077453 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4d2e0ea4-d1d5-4e88-924e-be6d5f0ad9af tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:14.199534 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4d2e0ea4-d1d5-4e88-924e-be6d5f0ad9af tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:14.209273 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4d2e0ea4-d1d5-4e88-924e-be6d5f0ad9af tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1241 microversion: 2.1 time: 0.141868 Aug 30 01:15:14.214271 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 339/643] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:14 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1241 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:14.361211 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-17c9dd36-0658-4d0c-ae7c-a67f4f173ff1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:14.376168 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-17c9dd36-0658-4d0c-ae7c-a67f4f173ff1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.368651 Aug 30 01:15:14.393930 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 305/644] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:14 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:14.527972 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-3e4a20ae-6eca-494d-9f4c-c653d3bb7534 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:14.529193 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-3e4a20ae-6eca-494d-9f4c-c653d3bb7534 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:14.538429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3e4a20ae-6eca-494d-9f4c-c653d3bb7534 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:14.543327 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3e4a20ae-6eca-494d-9f4c-c653d3bb7534 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:14.543327 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3e4a20ae-6eca-494d-9f4c-c653d3bb7534 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:14.543327 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3e4a20ae-6eca-494d-9f4c-c653d3bb7534 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:14.543327 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3e4a20ae-6eca-494d-9f4c-c653d3bb7534 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:14.543680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3e4a20ae-6eca-494d-9f4c-c653d3bb7534 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:14.583296 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-3e4a20ae-6eca-494d-9f4c-c653d3bb7534 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/os-volume_attachments/44a91d62-4c4f-41fd-9ae8-86e80546a880" status: 200 len: 194 microversion: 2.20 time: 0.060759 Aug 30 01:15:14.584671 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 340/645] 10.222.0.52 () {60 vars in 1454 bytes} [Tue Aug 30 01:15:14 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/os-volume_attachments/44a91d62-4c4f-41fd-9ae8-86e80546a880 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:15:14.673131 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-03d19726-33d9-4b05-9aae-ffbd537069dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:14.681262 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-03d19726-33d9-4b05-9aae-ffbd537069dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:14.687102 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03d19726-33d9-4b05-9aae-ffbd537069dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:14.687592 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03d19726-33d9-4b05-9aae-ffbd537069dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:14.688025 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03d19726-33d9-4b05-9aae-ffbd537069dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:14.689184 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03d19726-33d9-4b05-9aae-ffbd537069dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:14.689678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03d19726-33d9-4b05-9aae-ffbd537069dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:14.690125 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03d19726-33d9-4b05-9aae-ffbd537069dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:14.797137 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-03d19726-33d9-4b05-9aae-ffbd537069dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lazy-loading 'services' on Instance uuid d4475905-983f-47fb-8b8e-6c87baeac22d {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:15:15.093431 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-03d19726-33d9-4b05-9aae-ffbd537069dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/os-volume_attachments/44a91d62-4c4f-41fd-9ae8-86e80546a880" status: 202 len: 0 microversion: 2.20 time: 0.424224 Aug 30 01:15:15.095048 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 306/646] 10.222.0.52 () {60 vars in 1457 bytes} [Tue Aug 30 01:15:14 2022] DELETE /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/os-volume_attachments/44a91d62-4c4f-41fd-9ae8-86e80546a880 => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:15:15.105612 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-06c7fe6d-e3a5-4880-944a-8dbab19bfd68 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:15.108421 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-06c7fe6d-e3a5-4880-944a-8dbab19bfd68 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:15.115431 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-06c7fe6d-e3a5-4880-944a-8dbab19bfd68 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:15.116265 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-06c7fe6d-e3a5-4880-944a-8dbab19bfd68 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:15.116941 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-06c7fe6d-e3a5-4880-944a-8dbab19bfd68 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:15.117880 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-06c7fe6d-e3a5-4880-944a-8dbab19bfd68 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:15.123742 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-06c7fe6d-e3a5-4880-944a-8dbab19bfd68 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:15.125539 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-06c7fe6d-e3a5-4880-944a-8dbab19bfd68 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:15.164582 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-06c7fe6d-e3a5-4880-944a-8dbab19bfd68 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064019 Aug 30 01:15:15.170525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 341/647] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Aug 30 01:15:15 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:15:15.237077 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a8145fbc-ffa3-4491-b556-58f21e5d7f3e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:15.237077 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a8145fbc-ffa3-4491-b556-58f21e5d7f3e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:15.243861 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a8145fbc-ffa3-4491-b556-58f21e5d7f3e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:15.244617 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a8145fbc-ffa3-4491-b556-58f21e5d7f3e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:15.245053 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a8145fbc-ffa3-4491-b556-58f21e5d7f3e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:15.245771 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a8145fbc-ffa3-4491-b556-58f21e5d7f3e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:15.246214 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a8145fbc-ffa3-4491-b556-58f21e5d7f3e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:15.246636 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a8145fbc-ffa3-4491-b556-58f21e5d7f3e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:15.346399 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a8145fbc-ffa3-4491-b556-58f21e5d7f3e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:15.356175 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a8145fbc-ffa3-4491-b556-58f21e5d7f3e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1245 microversion: 2.1 time: 0.123507 Aug 30 01:15:15.366626 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 307/648] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:15 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1245 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:15.398321 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-dbf2e9cb-8fae-4408-abb7-d7995178fd5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:15.398931 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-dbf2e9cb-8fae-4408-abb7-d7995178fd5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:15.405190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dbf2e9cb-8fae-4408-abb7-d7995178fd5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:15.405674 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dbf2e9cb-8fae-4408-abb7-d7995178fd5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:15.406333 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dbf2e9cb-8fae-4408-abb7-d7995178fd5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:15.407043 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dbf2e9cb-8fae-4408-abb7-d7995178fd5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:15.407499 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dbf2e9cb-8fae-4408-abb7-d7995178fd5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:15.407924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dbf2e9cb-8fae-4408-abb7-d7995178fd5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:15.554843 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-dbf2e9cb-8fae-4408-abb7-d7995178fd5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:15.564119 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-dbf2e9cb-8fae-4408-abb7-d7995178fd5d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.169566 Aug 30 01:15:15.565316 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 342/649] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:15 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:16.178526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7a303393-b49d-454a-a2a7-7d56532d117f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:16.180861 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7a303393-b49d-454a-a2a7-7d56532d117f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:16.195680 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a303393-b49d-454a-a2a7-7d56532d117f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:16.198988 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a303393-b49d-454a-a2a7-7d56532d117f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:16.198988 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a303393-b49d-454a-a2a7-7d56532d117f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:16.198988 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a303393-b49d-454a-a2a7-7d56532d117f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:16.198988 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a303393-b49d-454a-a2a7-7d56532d117f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:16.199665 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a303393-b49d-454a-a2a7-7d56532d117f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:16.244565 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7a303393-b49d-454a-a2a7-7d56532d117f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070052 Aug 30 01:15:16.245546 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 308/650] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Aug 30 01:15:16 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:15:16.378193 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e8aa941f-4538-4c27-b8e8-7bf33dd13bb3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:16.378818 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e8aa941f-4538-4c27-b8e8-7bf33dd13bb3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:16.395742 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8aa941f-4538-4c27-b8e8-7bf33dd13bb3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:16.397479 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8aa941f-4538-4c27-b8e8-7bf33dd13bb3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:16.400445 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8aa941f-4538-4c27-b8e8-7bf33dd13bb3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:16.406524 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8aa941f-4538-4c27-b8e8-7bf33dd13bb3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:16.407026 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8aa941f-4538-4c27-b8e8-7bf33dd13bb3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:16.407472 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8aa941f-4538-4c27-b8e8-7bf33dd13bb3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:16.495878 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e8aa941f-4538-4c27-b8e8-7bf33dd13bb3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:16.502149 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e8aa941f-4538-4c27-b8e8-7bf33dd13bb3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1293 microversion: 2.1 time: 0.127597 Aug 30 01:15:16.502731 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 343/651] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:16 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1293 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:16.592094 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f2518f49-d4ff-4767-a564-139d9dcb73f7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:16.593679 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f2518f49-d4ff-4767-a564-139d9dcb73f7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:16.606067 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f2518f49-d4ff-4767-a564-139d9dcb73f7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:16.606864 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f2518f49-d4ff-4767-a564-139d9dcb73f7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:16.607724 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f2518f49-d4ff-4767-a564-139d9dcb73f7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:16.611868 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f2518f49-d4ff-4767-a564-139d9dcb73f7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:16.612580 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f2518f49-d4ff-4767-a564-139d9dcb73f7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:16.616747 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f2518f49-d4ff-4767-a564-139d9dcb73f7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:16.837568 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f2518f49-d4ff-4767-a564-139d9dcb73f7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:16.847103 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f2518f49-d4ff-4767-a564-139d9dcb73f7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.263078 Aug 30 01:15:16.847703 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 309/652] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:16 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:17.258418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-75637ce2-faea-48ee-9880-106adb31a3f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:17.260678 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-75637ce2-faea-48ee-9880-106adb31a3f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:17.267494 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75637ce2-faea-48ee-9880-106adb31a3f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:17.268102 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75637ce2-faea-48ee-9880-106adb31a3f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:17.268710 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75637ce2-faea-48ee-9880-106adb31a3f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:17.269224 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75637ce2-faea-48ee-9880-106adb31a3f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:17.269674 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75637ce2-faea-48ee-9880-106adb31a3f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:17.270130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75637ce2-faea-48ee-9880-106adb31a3f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:17.311169 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-75637ce2-faea-48ee-9880-106adb31a3f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057037 Aug 30 01:15:17.312026 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 344/653] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Aug 30 01:15:17 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:17.389187 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-14a4744a-8606-4e56-96e1-d466789257f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:17.390363 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-14a4744a-8606-4e56-96e1-d466789257f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:17.402670 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14a4744a-8606-4e56-96e1-d466789257f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:17.405218 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14a4744a-8606-4e56-96e1-d466789257f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:17.406643 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14a4744a-8606-4e56-96e1-d466789257f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:17.411051 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14a4744a-8606-4e56-96e1-d466789257f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:17.411051 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14a4744a-8606-4e56-96e1-d466789257f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:17.411051 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14a4744a-8606-4e56-96e1-d466789257f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:17.450916 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-14a4744a-8606-4e56-96e1-d466789257f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:15:17.525861 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5023288f-97b6-4ec4-8d18-b70c0b017b2a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:17.526715 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5023288f-97b6-4ec4-8d18-b70c0b017b2a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:17.536039 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5023288f-97b6-4ec4-8d18-b70c0b017b2a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:17.536813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5023288f-97b6-4ec4-8d18-b70c0b017b2a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:17.537447 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5023288f-97b6-4ec4-8d18-b70c0b017b2a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:17.538238 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5023288f-97b6-4ec4-8d18-b70c0b017b2a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:17.538884 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5023288f-97b6-4ec4-8d18-b70c0b017b2a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:17.539481 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5023288f-97b6-4ec4-8d18-b70c0b017b2a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:17.625318 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5023288f-97b6-4ec4-8d18-b70c0b017b2a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:17.633525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5023288f-97b6-4ec4-8d18-b70c0b017b2a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1311 microversion: 2.1 time: 0.111626 Aug 30 01:15:17.635870 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 345/654] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:17 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:17.819767 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-14a4744a-8606-4e56-96e1-d466789257f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 204 len: 0 microversion: 2.20 time: 0.434776 Aug 30 01:15:17.820786 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 310/655] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Aug 30 01:15:17 2022] DELETE /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 01:15:17.830343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a71b28f5-7d99-488b-bb6b-abd3b6f6ed42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:17.831488 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a71b28f5-7d99-488b-bb6b-abd3b6f6ed42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:17.840329 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a71b28f5-7d99-488b-bb6b-abd3b6f6ed42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:17.841016 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a71b28f5-7d99-488b-bb6b-abd3b6f6ed42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:17.841662 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a71b28f5-7d99-488b-bb6b-abd3b6f6ed42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:17.842675 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a71b28f5-7d99-488b-bb6b-abd3b6f6ed42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:17.843211 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a71b28f5-7d99-488b-bb6b-abd3b6f6ed42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:17.843741 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a71b28f5-7d99-488b-bb6b-abd3b6f6ed42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:17.874317 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ede8201c-68af-421b-aafc-0ce878e0149b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:17.875316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ede8201c-68af-421b-aafc-0ce878e0149b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:17.887058 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ede8201c-68af-421b-aafc-0ce878e0149b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:17.887058 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ede8201c-68af-421b-aafc-0ce878e0149b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:17.887058 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ede8201c-68af-421b-aafc-0ce878e0149b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:17.887058 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ede8201c-68af-421b-aafc-0ce878e0149b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:17.888141 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ede8201c-68af-421b-aafc-0ce878e0149b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:17.888754 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ede8201c-68af-421b-aafc-0ce878e0149b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:17.918089 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:18.027945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a71b28f5-7d99-488b-bb6b-abd3b6f6ed42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:18.036349 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a71b28f5-7d99-488b-bb6b-abd3b6f6ed42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:18.040653 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a71b28f5-7d99-488b-bb6b-abd3b6f6ed42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:18.042583 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a71b28f5-7d99-488b-bb6b-abd3b6f6ed42 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.216994 Aug 30 01:15:18.044924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 346/656] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:17 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:18.116986 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ede8201c-68af-421b-aafc-0ce878e0149b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:18.125859 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ede8201c-68af-421b-aafc-0ce878e0149b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.256125 Aug 30 01:15:18.126840 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 311/657] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:17 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:18.676113 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-922ca7e2-3b4e-40bd-8e9b-0fcd1763e33c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:18.679657 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-922ca7e2-3b4e-40bd-8e9b-0fcd1763e33c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:18.685609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-922ca7e2-3b4e-40bd-8e9b-0fcd1763e33c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:18.686402 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-922ca7e2-3b4e-40bd-8e9b-0fcd1763e33c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:18.686999 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-922ca7e2-3b4e-40bd-8e9b-0fcd1763e33c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:18.687886 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-922ca7e2-3b4e-40bd-8e9b-0fcd1763e33c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:18.689134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-922ca7e2-3b4e-40bd-8e9b-0fcd1763e33c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:18.689780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-922ca7e2-3b4e-40bd-8e9b-0fcd1763e33c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:19.072317 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-03d49207-0974-4f9b-9544-6852ed1911bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:19.073698 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-03d49207-0974-4f9b-9544-6852ed1911bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:19.095219 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03d49207-0974-4f9b-9544-6852ed1911bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:19.095219 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03d49207-0974-4f9b-9544-6852ed1911bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:19.095741 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03d49207-0974-4f9b-9544-6852ed1911bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:19.096724 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03d49207-0974-4f9b-9544-6852ed1911bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:19.097408 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03d49207-0974-4f9b-9544-6852ed1911bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:19.098083 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03d49207-0974-4f9b-9544-6852ed1911bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:19.193852 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-922ca7e2-3b4e-40bd-8e9b-0fcd1763e33c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:19.206316 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-922ca7e2-3b4e-40bd-8e9b-0fcd1763e33c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1366 microversion: 2.1 time: 0.536544 Aug 30 01:15:19.216862 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 347/658] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:18 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1366 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:19.226564 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-cc4eca8f-77dc-4cf5-b4be-35d7b33ffc29 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:19.227374 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-cc4eca8f-77dc-4cf5-b4be-35d7b33ffc29 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:19.242426 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc4eca8f-77dc-4cf5-b4be-35d7b33ffc29 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:19.242923 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc4eca8f-77dc-4cf5-b4be-35d7b33ffc29 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:19.244115 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc4eca8f-77dc-4cf5-b4be-35d7b33ffc29 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:19.244891 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc4eca8f-77dc-4cf5-b4be-35d7b33ffc29 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:19.245356 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc4eca8f-77dc-4cf5-b4be-35d7b33ffc29 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:19.250796 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc4eca8f-77dc-4cf5-b4be-35d7b33ffc29 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:19.324384 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-03d49207-0974-4f9b-9544-6852ed1911bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:19.334444 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-03d49207-0974-4f9b-9544-6852ed1911bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:19.336933 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-03d49207-0974-4f9b-9544-6852ed1911bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:19.338392 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-03d49207-0974-4f9b-9544-6852ed1911bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.271068 Aug 30 01:15:19.350672 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 312/659] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:19 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:19.435542 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-cc4eca8f-77dc-4cf5-b4be-35d7b33ffc29 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:19.446082 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-cc4eca8f-77dc-4cf5-b4be-35d7b33ffc29 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.227803 Aug 30 01:15:19.468568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 348/660] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:19 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:20.233510 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6d856882-d265-41e0-bf8a-8362a07c1385 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:20.234782 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6d856882-d265-41e0-bf8a-8362a07c1385 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:20.247732 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d856882-d265-41e0-bf8a-8362a07c1385 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:20.248687 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d856882-d265-41e0-bf8a-8362a07c1385 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:20.249409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d856882-d265-41e0-bf8a-8362a07c1385 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:20.250782 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d856882-d265-41e0-bf8a-8362a07c1385 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:20.251485 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d856882-d265-41e0-bf8a-8362a07c1385 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:20.252085 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d856882-d265-41e0-bf8a-8362a07c1385 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:20.361927 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-718f5633-ae98-4a60-967c-74610955033d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:20.363103 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-718f5633-ae98-4a60-967c-74610955033d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:20.376782 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-718f5633-ae98-4a60-967c-74610955033d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:20.377309 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-718f5633-ae98-4a60-967c-74610955033d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:20.377823 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-718f5633-ae98-4a60-967c-74610955033d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:20.382571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-718f5633-ae98-4a60-967c-74610955033d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:20.383084 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-718f5633-ae98-4a60-967c-74610955033d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:20.383522 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-718f5633-ae98-4a60-967c-74610955033d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:20.431191 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6d856882-d265-41e0-bf8a-8362a07c1385 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:20.445485 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6d856882-d265-41e0-bf8a-8362a07c1385 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1366 microversion: 2.1 time: 0.218141 Aug 30 01:15:20.447432 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 313/661] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:20 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:20.483554 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a3df0261-c858-49c9-8a3f-f22beb82430e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:20.485516 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a3df0261-c858-49c9-8a3f-f22beb82430e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:20.513867 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3df0261-c858-49c9-8a3f-f22beb82430e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:20.514707 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3df0261-c858-49c9-8a3f-f22beb82430e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:20.515381 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3df0261-c858-49c9-8a3f-f22beb82430e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:20.516410 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3df0261-c858-49c9-8a3f-f22beb82430e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:20.520389 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3df0261-c858-49c9-8a3f-f22beb82430e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:20.521229 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3df0261-c858-49c9-8a3f-f22beb82430e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:20.719153 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-718f5633-ae98-4a60-967c-74610955033d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:20.729556 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-718f5633-ae98-4a60-967c-74610955033d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:20.731295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-718f5633-ae98-4a60-967c-74610955033d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:20.733442 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-718f5633-ae98-4a60-967c-74610955033d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.375621 Aug 30 01:15:20.754273 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 349/662] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:20 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:15:20.760265 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-e0f98d85-0795-4916-999f-793a810e1db3 req-01da470e-1542-466d-abd1-d4515ef72f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81845d9a-a800-4e7a-8edd-7d6329dd6db2", "tag": "ebd82af4-7bf6-4f28-91c9-b9f6fc86225c"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:20.765021 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a3df0261-c858-49c9-8a3f-f22beb82430e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:20.770282 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-e0f98d85-0795-4916-999f-793a810e1db3 req-01da470e-1542-466d-abd1-d4515ef72f47 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:20.770754 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-e0f98d85-0795-4916-999f-793a810e1db3 req-01da470e-1542-466d-abd1-d4515ef72f47 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:20.771176 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-e0f98d85-0795-4916-999f-793a810e1db3 req-01da470e-1542-466d-abd1-d4515ef72f47 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:20.776944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a3df0261-c858-49c9-8a3f-f22beb82430e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.311371 Aug 30 01:15:20.787166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-e0f98d85-0795-4916-999f-793a810e1db3 req-01da470e-1542-466d-abd1-d4515ef72f47 service nova] Creating event network-changed:ebd82af4-7bf6-4f28-91c9-b9f6fc86225c for instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 on hv-cinder-81571 Aug 30 01:15:20.792308 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 314/663] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:20 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:20.793050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-e0f98d85-0795-4916-999f-793a810e1db3 req-01da470e-1542-466d-abd1-d4515ef72f47 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036978 Aug 30 01:15:20.794153 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 350/664] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:21.472700 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-495ca691-ce2f-4522-b962-03bbe37befff tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:21.473363 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-495ca691-ce2f-4522-b962-03bbe37befff tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:21.484078 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-495ca691-ce2f-4522-b962-03bbe37befff tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:21.488282 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-495ca691-ce2f-4522-b962-03bbe37befff tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:21.488918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-495ca691-ce2f-4522-b962-03bbe37befff tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:21.490038 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-495ca691-ce2f-4522-b962-03bbe37befff tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:21.490660 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-495ca691-ce2f-4522-b962-03bbe37befff tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:21.491862 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-495ca691-ce2f-4522-b962-03bbe37befff tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:21.785542 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ae887a3b-7ee9-4201-9bb2-24a27411336c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:21.786298 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ae887a3b-7ee9-4201-9bb2-24a27411336c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:21.794325 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ae887a3b-7ee9-4201-9bb2-24a27411336c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:21.795232 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ae887a3b-7ee9-4201-9bb2-24a27411336c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:21.795902 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ae887a3b-7ee9-4201-9bb2-24a27411336c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:21.796823 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ae887a3b-7ee9-4201-9bb2-24a27411336c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:21.797683 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ae887a3b-7ee9-4201-9bb2-24a27411336c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:21.798407 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ae887a3b-7ee9-4201-9bb2-24a27411336c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:21.874190 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-495ca691-ce2f-4522-b962-03bbe37befff tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:21.891336 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-495ca691-ce2f-4522-b962-03bbe37befff tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1366 microversion: 2.1 time: 0.422263 Aug 30 01:15:21.985032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 315/665] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:21 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:21.985032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c9ba32bf-f6a1-4478-94cb-799fc3b2aa6e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:21.985032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c9ba32bf-f6a1-4478-94cb-799fc3b2aa6e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:21.985032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c9ba32bf-f6a1-4478-94cb-799fc3b2aa6e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:21.986346 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c9ba32bf-f6a1-4478-94cb-799fc3b2aa6e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:21.986346 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c9ba32bf-f6a1-4478-94cb-799fc3b2aa6e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:21.986346 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c9ba32bf-f6a1-4478-94cb-799fc3b2aa6e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:21.986346 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c9ba32bf-f6a1-4478-94cb-799fc3b2aa6e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:21.986950 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c9ba32bf-f6a1-4478-94cb-799fc3b2aa6e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:21.990816 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ae887a3b-7ee9-4201-9bb2-24a27411336c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:22.003132 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ae887a3b-7ee9-4201-9bb2-24a27411336c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:22.009561 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ae887a3b-7ee9-4201-9bb2-24a27411336c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:22.014788 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ae887a3b-7ee9-4201-9bb2-24a27411336c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1723 microversion: 2.20 time: 0.256340 Aug 30 01:15:22.015479 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 351/666] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:21 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:22.163118 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c9ba32bf-f6a1-4478-94cb-799fc3b2aa6e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:22.177156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c9ba32bf-f6a1-4478-94cb-799fc3b2aa6e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.283469 Aug 30 01:15:22.177778 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 316/667] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:21 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:22.811849 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-1f5014c0-363c-42dd-a14d-11e862af362d req-9b063ca9-89e2-4f19-8bc6-e44f68a4eb6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4475905-983f-47fb-8b8e-6c87baeac22d", "name": "network-vif-deleted", "tag": "3efaeb1f-3500-4863-b27f-c56c1aa2946c"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:22.829291 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-1f5014c0-363c-42dd-a14d-11e862af362d req-9b063ca9-89e2-4f19-8bc6-e44f68a4eb6b service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:22.830743 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-1f5014c0-363c-42dd-a14d-11e862af362d req-9b063ca9-89e2-4f19-8bc6-e44f68a4eb6b service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:22.831359 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-1f5014c0-363c-42dd-a14d-11e862af362d req-9b063ca9-89e2-4f19-8bc6-e44f68a4eb6b service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:22.852089 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-1f5014c0-363c-42dd-a14d-11e862af362d req-9b063ca9-89e2-4f19-8bc6-e44f68a4eb6b service nova] Creating event network-vif-deleted:3efaeb1f-3500-4863-b27f-c56c1aa2946c for instance d4475905-983f-47fb-8b8e-6c87baeac22d on hv-cinder-81571 Aug 30 01:15:22.877047 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-1f5014c0-363c-42dd-a14d-11e862af362d req-9b063ca9-89e2-4f19-8bc6-e44f68a4eb6b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068597 Aug 30 01:15:22.877929 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 352/668] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:22.971900 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7fe12b47-c345-41a4-bc1a-e3ad275c358d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:22.972511 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7fe12b47-c345-41a4-bc1a-e3ad275c358d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:22.980967 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7fe12b47-c345-41a4-bc1a-e3ad275c358d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:22.981707 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7fe12b47-c345-41a4-bc1a-e3ad275c358d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:22.982170 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7fe12b47-c345-41a4-bc1a-e3ad275c358d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:22.983119 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7fe12b47-c345-41a4-bc1a-e3ad275c358d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:22.983824 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7fe12b47-c345-41a4-bc1a-e3ad275c358d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:22.985032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7fe12b47-c345-41a4-bc1a-e3ad275c358d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:23.043373 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-232c7c52-ae75-4f05-b449-818d228c355e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:23.044086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-232c7c52-ae75-4f05-b449-818d228c355e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:23.060587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-232c7c52-ae75-4f05-b449-818d228c355e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:23.063796 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-232c7c52-ae75-4f05-b449-818d228c355e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:23.064642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-232c7c52-ae75-4f05-b449-818d228c355e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:23.065935 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-232c7c52-ae75-4f05-b449-818d228c355e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:23.070647 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-232c7c52-ae75-4f05-b449-818d228c355e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:23.071361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-232c7c52-ae75-4f05-b449-818d228c355e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:23.168546 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-232c7c52-ae75-4f05-b449-818d228c355e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:23.174019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=100 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:23.183822 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-232c7c52-ae75-4f05-b449-818d228c355e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:23.185837 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-232c7c52-ae75-4f05-b449-818d228c355e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:23.187474 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-232c7c52-ae75-4f05-b449-818d228c355e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1656 microversion: 2.20 time: 0.152264 Aug 30 01:15:23.188571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 353/669] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:23 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1656 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:15:23.210851 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ebb7f148-680e-4ae1-a7a4-77159ce08ce7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:23.212449 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ebb7f148-680e-4ae1-a7a4-77159ce08ce7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:23.237528 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebb7f148-680e-4ae1-a7a4-77159ce08ce7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:23.238877 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebb7f148-680e-4ae1-a7a4-77159ce08ce7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:23.239518 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebb7f148-680e-4ae1-a7a4-77159ce08ce7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:23.240423 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebb7f148-680e-4ae1-a7a4-77159ce08ce7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:23.241973 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7fe12b47-c345-41a4-bc1a-e3ad275c358d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:23.246332 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebb7f148-680e-4ae1-a7a4-77159ce08ce7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:23.247013 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebb7f148-680e-4ae1-a7a4-77159ce08ce7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:23.252581 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7fe12b47-c345-41a4-bc1a-e3ad275c358d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1366 microversion: 2.1 time: 0.286147 Aug 30 01:15:23.253705 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 317/670] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:22 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:23.481568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ebb7f148-680e-4ae1-a7a4-77159ce08ce7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:23.492475 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ebb7f148-680e-4ae1-a7a4-77159ce08ce7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1735 microversion: 2.1 time: 0.296080 Aug 30 01:15:23.512384 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 354/671] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:23 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1735 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:24.211706 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-14b404e0-dd0a-4891-bdb5-b20bb6fee8b0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:24.213212 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-14b404e0-dd0a-4891-bdb5-b20bb6fee8b0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:24.215905 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:24.224274 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14b404e0-dd0a-4891-bdb5-b20bb6fee8b0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:24.225127 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14b404e0-dd0a-4891-bdb5-b20bb6fee8b0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:24.225810 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14b404e0-dd0a-4891-bdb5-b20bb6fee8b0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:24.226968 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14b404e0-dd0a-4891-bdb5-b20bb6fee8b0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:24.227917 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14b404e0-dd0a-4891-bdb5-b20bb6fee8b0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:24.228606 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14b404e0-dd0a-4891-bdb5-b20bb6fee8b0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:24.269576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14b404e0-dd0a-4891-bdb5-b20bb6fee8b0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:24.270154 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14b404e0-dd0a-4891-bdb5-b20bb6fee8b0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:24.270752 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14b404e0-dd0a-4891-bdb5-b20bb6fee8b0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:24.271330 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-14b404e0-dd0a-4891-bdb5-b20bb6fee8b0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lazy-loading 'fault' on Instance uuid d4475905-983f-47fb-8b8e-6c87baeac22d {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:15:24.273650 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9ab8b63a-f6c1-41ec-8783-10367da80638 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:24.274926 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9ab8b63a-f6c1-41ec-8783-10367da80638 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:24.286708 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=2 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:24.293291 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=12 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:24.297257 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9ab8b63a-f6c1-41ec-8783-10367da80638 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:24.297777 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9ab8b63a-f6c1-41ec-8783-10367da80638 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:24.298213 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9ab8b63a-f6c1-41ec-8783-10367da80638 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:24.298924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9ab8b63a-f6c1-41ec-8783-10367da80638 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:24.299382 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9ab8b63a-f6c1-41ec-8783-10367da80638 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:24.299800 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9ab8b63a-f6c1-41ec-8783-10367da80638 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:24.327340 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-14b404e0-dd0a-4891-bdb5-b20bb6fee8b0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:24.343358 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-14b404e0-dd0a-4891-bdb5-b20bb6fee8b0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:24.345387 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-14b404e0-dd0a-4891-bdb5-b20bb6fee8b0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:24.346826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-14b404e0-dd0a-4891-bdb5-b20bb6fee8b0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1372 microversion: 2.20 time: 0.139653 Aug 30 01:15:24.347634 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 318/672] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:24 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1372 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:24.514666 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9ab8b63a-f6c1-41ec-8783-10367da80638 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:24.518546 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9ab8b63a-f6c1-41ec-8783-10367da80638 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1366 microversion: 2.1 time: 0.248263 Aug 30 01:15:24.519163 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 355/673] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:24 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:24.520209 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e1e8328d-e241-4f49-a6a3-3150a2a61cf1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:24.521127 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e1e8328d-e241-4f49-a6a3-3150a2a61cf1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:24.528876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e1e8328d-e241-4f49-a6a3-3150a2a61cf1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:24.529656 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e1e8328d-e241-4f49-a6a3-3150a2a61cf1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:24.530217 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e1e8328d-e241-4f49-a6a3-3150a2a61cf1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:24.531037 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e1e8328d-e241-4f49-a6a3-3150a2a61cf1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:24.531590 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e1e8328d-e241-4f49-a6a3-3150a2a61cf1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:24.532112 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e1e8328d-e241-4f49-a6a3-3150a2a61cf1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:24.690381 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e1e8328d-e241-4f49-a6a3-3150a2a61cf1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:24.701789 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e1e8328d-e241-4f49-a6a3-3150a2a61cf1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1715 microversion: 2.1 time: 0.185594 Aug 30 01:15:24.702650 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 319/674] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:24 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1715 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:24.846036 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-43cf6ad6-96b9-4663-b422-420ac9a7d65f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:24.846896 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-43cf6ad6-96b9-4663-b422-420ac9a7d65f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:24.853697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-43cf6ad6-96b9-4663-b422-420ac9a7d65f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:24.854219 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-43cf6ad6-96b9-4663-b422-420ac9a7d65f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:24.854874 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-43cf6ad6-96b9-4663-b422-420ac9a7d65f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:24.855602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-43cf6ad6-96b9-4663-b422-420ac9a7d65f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:24.856059 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-43cf6ad6-96b9-4663-b422-420ac9a7d65f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:24.856485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-43cf6ad6-96b9-4663-b422-420ac9a7d65f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:24.948126 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-43cf6ad6-96b9-4663-b422-420ac9a7d65f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] HTTP exception thrown: Cannot 'detach_volume' instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d while it is in vm_state rescued Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-43cf6ad6-96b9-4663-b422-420ac9a7d65f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Request method failure captured: Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: DELETE /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-volume_attachments/47f563a0-540e-4e8c-8f8a-6a8f6619e06e HTTP/1.1 Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOeQEJvJe1oPgcAM0CJuHJZAsxaDOqgO7QH27qraPSKUTsAC4XPuYjUu6EVHrur_xArtWyqCb5JWbnssK7EJqykgUjLDeCSyIoPGge8kiHjsHWrlFHhD6AcbhjW0-wlasX1OPO3NkTkkmdkpMoIb_wVF9xmCsbss_a5nytHoL3C3Tw Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 9f0605a8a2fe48e49a410127b5f3b32c Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1432841125 Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:15:24.949945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:15:24.951516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:15:24.951516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1432841125 Aug 30 01:15:24.951516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 9f0605a8a2fe48e49a410127b5f3b32c Aug 30 01:15:24.951516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1432841125 Aug 30 01:15:24.951516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-ServerRescueNegativeTestJSON-1432841125-project Aug 30 01:15:24.951516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:15:24.951516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:15:24.951516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 76ea3ed3bb2b412093004c7e0f49c7ce Aug 30 01:15:24.951516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1432841125-project Aug 30 01:15:24.951516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:15:24.951516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Cannot 'detach_volume' instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d while it is in vm_state rescued Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'server_id': '3cc62a7d-bbdb-4131-b8bc-ab85635ad17d', 'id': '47f563a0-540e-4e8c-8f8a-6a8f6619e06e'} Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:15:24.952314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:15:24.953838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 01:15:24.953838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 01:15:24.953838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 01:15:24.953838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 01:15:24.953838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d while it is in vm_state rescued Aug 30 01:15:24.953838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:15:24.953838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:15:24.953838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:15:24.953838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:15:24.953838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:15:24.953838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:15:24.953838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:15:24.953838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:15:24.953838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d while it is in vm_state rescued Aug 30 01:15:24.953838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:15:24.955836 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-43cf6ad6-96b9-4663-b422-420ac9a7d65f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Returning 409 to user: Cannot 'detach_volume' instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d while it is in vm_state rescued {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:15:24.956845 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-43cf6ad6-96b9-4663-b422-420ac9a7d65f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-volume_attachments/47f563a0-540e-4e8c-8f8a-6a8f6619e06e" status: 409 len: 152 microversion: 2.1 time: 0.116129 Aug 30 01:15:24.957554 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 356/675] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 30 01:15:24 2022] DELETE /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-volume_attachments/47f563a0-540e-4e8c-8f8a-6a8f6619e06e => generated 152 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 01:15:24.967219 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c2f85278-ac09-4816-8eaa-863c9111cb0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:24.967748 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c2f85278-ac09-4816-8eaa-863c9111cb0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:24.973774 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2f85278-ac09-4816-8eaa-863c9111cb0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:24.974263 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2f85278-ac09-4816-8eaa-863c9111cb0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:24.974699 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2f85278-ac09-4816-8eaa-863c9111cb0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:24.975655 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2f85278-ac09-4816-8eaa-863c9111cb0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:24.976118 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2f85278-ac09-4816-8eaa-863c9111cb0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:24.976540 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2f85278-ac09-4816-8eaa-863c9111cb0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:25.154834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c2f85278-ac09-4816-8eaa-863c9111cb0b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "POST /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/action" status: 202 len: 0 microversion: 2.1 time: 0.191559 Aug 30 01:15:25.155749 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 320/676] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 30 01:15:24 2022] POST /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:15:25.165969 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-163900b7-dfd3-4ad4-b161-24ed307dbc96 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:25.166582 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-163900b7-dfd3-4ad4-b161-24ed307dbc96 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:25.176434 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-163900b7-dfd3-4ad4-b161-24ed307dbc96 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:25.176921 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-163900b7-dfd3-4ad4-b161-24ed307dbc96 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:25.177396 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-163900b7-dfd3-4ad4-b161-24ed307dbc96 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:25.178141 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-163900b7-dfd3-4ad4-b161-24ed307dbc96 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:25.178599 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-163900b7-dfd3-4ad4-b161-24ed307dbc96 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:25.179027 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-163900b7-dfd3-4ad4-b161-24ed307dbc96 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:25.326766 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-163900b7-dfd3-4ad4-b161-24ed307dbc96 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:25.335772 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-163900b7-dfd3-4ad4-b161-24ed307dbc96 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1723 microversion: 2.1 time: 0.173966 Aug 30 01:15:25.336264 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 357/677] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:25 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:25.372326 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2902f3e2-a407-4db4-81ab-c66fec46f9b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:25.374315 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2902f3e2-a407-4db4-81ab-c66fec46f9b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:25.381268 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2902f3e2-a407-4db4-81ab-c66fec46f9b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:25.382076 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2902f3e2-a407-4db4-81ab-c66fec46f9b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:25.382667 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2902f3e2-a407-4db4-81ab-c66fec46f9b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:25.383875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2902f3e2-a407-4db4-81ab-c66fec46f9b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:25.384485 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2902f3e2-a407-4db4-81ab-c66fec46f9b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:25.385094 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2902f3e2-a407-4db4-81ab-c66fec46f9b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:25.431742 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2902f3e2-a407-4db4-81ab-c66fec46f9b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:25.432332 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2902f3e2-a407-4db4-81ab-c66fec46f9b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:25.432847 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2902f3e2-a407-4db4-81ab-c66fec46f9b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:25.433442 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-2902f3e2-a407-4db4-81ab-c66fec46f9b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lazy-loading 'fault' on Instance uuid d4475905-983f-47fb-8b8e-6c87baeac22d {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:15:25.486518 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2902f3e2-a407-4db4-81ab-c66fec46f9b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:25.495906 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2902f3e2-a407-4db4-81ab-c66fec46f9b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:25.497417 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2902f3e2-a407-4db4-81ab-c66fec46f9b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:25.499246 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2902f3e2-a407-4db4-81ab-c66fec46f9b5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 200 len: 1372 microversion: 2.20 time: 0.131314 Aug 30 01:15:25.499813 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 321/678] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:25 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 1372 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:25.547034 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-efe34805-eb9e-4d80-974f-46a6983fb9ba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:25.547821 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-efe34805-eb9e-4d80-974f-46a6983fb9ba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:25.557471 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-efe34805-eb9e-4d80-974f-46a6983fb9ba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:25.558138 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-efe34805-eb9e-4d80-974f-46a6983fb9ba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:25.558796 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-efe34805-eb9e-4d80-974f-46a6983fb9ba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:25.559830 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-efe34805-eb9e-4d80-974f-46a6983fb9ba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:25.560507 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-efe34805-eb9e-4d80-974f-46a6983fb9ba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:25.561166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-efe34805-eb9e-4d80-974f-46a6983fb9ba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:25.752965 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-efe34805-eb9e-4d80-974f-46a6983fb9ba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:25.762065 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-efe34805-eb9e-4d80-974f-46a6983fb9ba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1366 microversion: 2.1 time: 0.223957 Aug 30 01:15:25.762660 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 358/679] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:25 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:26.359495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3ef64ce3-cd2a-4f46-973b-d2372e97e255 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:26.360096 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3ef64ce3-cd2a-4f46-973b-d2372e97e255 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:26.365990 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ef64ce3-cd2a-4f46-973b-d2372e97e255 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:26.366468 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ef64ce3-cd2a-4f46-973b-d2372e97e255 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:26.366901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ef64ce3-cd2a-4f46-973b-d2372e97e255 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:26.367573 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ef64ce3-cd2a-4f46-973b-d2372e97e255 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:26.368613 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ef64ce3-cd2a-4f46-973b-d2372e97e255 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:26.369122 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3ef64ce3-cd2a-4f46-973b-d2372e97e255 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:26.507450 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3ef64ce3-cd2a-4f46-973b-d2372e97e255 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:26.516325 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3ef64ce3-cd2a-4f46-973b-d2372e97e255 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1723 microversion: 2.1 time: 0.160649 Aug 30 01:15:26.517111 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 322/680] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:26 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:26.532134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a8edfb86-ffa7-42ce-b004-a6e06a4971fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:26.532134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a8edfb86-ffa7-42ce-b004-a6e06a4971fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:26.534326 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a8edfb86-ffa7-42ce-b004-a6e06a4971fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:26.534909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a8edfb86-ffa7-42ce-b004-a6e06a4971fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:26.535424 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a8edfb86-ffa7-42ce-b004-a6e06a4971fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:26.536229 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a8edfb86-ffa7-42ce-b004-a6e06a4971fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:26.536755 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a8edfb86-ffa7-42ce-b004-a6e06a4971fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:26.537261 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a8edfb86-ffa7-42ce-b004-a6e06a4971fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:26.553023 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-a8edfb86-ffa7-42ce-b004-a6e06a4971fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] HTTP exception thrown: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a8edfb86-ffa7-42ce-b004-a6e06a4971fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Request method failure captured: Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d HTTP/1.1 Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOivkuTXOvG5D3941-UhtqEXRKlp9qTLSRyef7QzbcDzDStlPyt-TyZ9PYBXlf6OL_Z-2KInO_8p8NaBH2nPXqSsi7KL78QaKqf7qONKo3bpSQkPEoeHRsX-Jj4_b8vjC6DstRjzocFFZ3EwZvoS7ARTdCaY8dJyUhVfsybaLrsniM Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 742c089b0dea4b1f89efd31f48f9ffc5 Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:15:26.554182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:15:26.556585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:15:26.556585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:15:26.556585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 742c089b0dea4b1f89efd31f48f9ffc5 Aug 30 01:15:26.556585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:15:26.556585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-AttachVolumeShelveTestJSON-1371239707-project Aug 30 01:15:26.556585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:15:26.556585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:15:26.556585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 2ffe5c7cb44f476e913d64003105002c Aug 30 01:15:26.556585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1371239707-project Aug 30 01:15:26.556585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:15:26.556585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. Aug 30 01:15:26.556585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': 'd4475905-983f-47fb-8b8e-6c87baeac22d'} Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:15:26.557437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. Aug 30 01:15:26.558890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:15:26.563635 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a8edfb86-ffa7-42ce-b004-a6e06a4971fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Returning 404 to user: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:15:26.563635 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a8edfb86-ffa7-42ce-b004-a6e06a4971fa tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 404 len: 111 microversion: 2.20 time: 0.034937 Aug 30 01:15:26.563635 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 359/681] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:26 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 01:15:26.568774 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e7d1689f-d9eb-4102-a7b4-925eae2b807a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '.version_select at 0x7fd71d0f6790>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:26.650677 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e7d1689f-d9eb-4102-a7b4-925eae2b807a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1085343442" status: 204 len: 0 microversion: 2.20 time: 0.085954 Aug 30 01:15:26.651381 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 323/682] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Aug 30 01:15:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1085343442 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 01:15:26.784558 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ea359dc0-5c70-436e-991c-e28c88b321ce tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:26.785288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ea359dc0-5c70-436e-991c-e28c88b321ce tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:26.793152 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ea359dc0-5c70-436e-991c-e28c88b321ce tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:26.793649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ea359dc0-5c70-436e-991c-e28c88b321ce tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:26.797098 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ea359dc0-5c70-436e-991c-e28c88b321ce tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:26.797909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ea359dc0-5c70-436e-991c-e28c88b321ce tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:26.798568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ea359dc0-5c70-436e-991c-e28c88b321ce tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:26.800853 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ea359dc0-5c70-436e-991c-e28c88b321ce tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:27.023326 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ea359dc0-5c70-436e-991c-e28c88b321ce tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:27.034877 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ea359dc0-5c70-436e-991c-e28c88b321ce tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1366 microversion: 2.1 time: 0.255287 Aug 30 01:15:27.035741 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 360/683] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:26 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:27.543799 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ea8b538e-6540-4f63-9a48-ac2dd16f9543 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:27.544403 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ea8b538e-6540-4f63-9a48-ac2dd16f9543 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:27.559778 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea8b538e-6540-4f63-9a48-ac2dd16f9543 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:27.566925 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9107bae3-259c-4d7b-997a-19a2a290fda1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Action: 'create', calling method: .version_select at 0x7fd71cec15e0>, body: {"keypair": {"name": "tempest-keypair-539486766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbPIgmVZDXoPbWkK5oIq7dBtk5r3PsPIkL3iIXSQ4WpuixOmiofj5oNgNEQQrxL2nU02eoy4HHiU04P9trhVjIBE3cZ60QrONGLRFZe+ehVBq6LJBawvwvohT7d8TSVnw=="}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:27.573598 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea8b538e-6540-4f63-9a48-ac2dd16f9543 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:27.574233 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea8b538e-6540-4f63-9a48-ac2dd16f9543 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:27.574986 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea8b538e-6540-4f63-9a48-ac2dd16f9543 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:27.575451 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea8b538e-6540-4f63-9a48-ac2dd16f9543 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:27.575872 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea8b538e-6540-4f63-9a48-ac2dd16f9543 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:27.604760 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-9107bae3-259c-4d7b-997a-19a2a290fda1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Getting quotas for project 742c089b0dea4b1f89efd31f48f9ffc5. Resources: {'key_pairs'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:15:27.609181 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-9107bae3-259c-4d7b-997a-19a2a290fda1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Getting quotas for user 2ffe5c7cb44f476e913d64003105002c and project 742c089b0dea4b1f89efd31f48f9ffc5. Resources: {'key_pairs'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:15:27.635862 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:27.731448 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9107bae3-259c-4d7b-997a-19a2a290fda1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.169373 Aug 30 01:15:27.732346 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 361/684] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Aug 30 01:15:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 171 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 01:15:27.762465 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ea8b538e-6540-4f63-9a48-ac2dd16f9543 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:27.771856 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ea8b538e-6540-4f63-9a48-ac2dd16f9543 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1723 microversion: 2.1 time: 0.233346 Aug 30 01:15:27.782293 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 324/685] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:27 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:28.056859 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-68856520-6e3b-4620-ac2b-cb75112dfd37 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:28.058003 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-68856520-6e3b-4620-ac2b-cb75112dfd37 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:28.065268 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-68856520-6e3b-4620-ac2b-cb75112dfd37 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:28.066184 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-68856520-6e3b-4620-ac2b-cb75112dfd37 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:28.066847 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-68856520-6e3b-4620-ac2b-cb75112dfd37 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:28.067777 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-68856520-6e3b-4620-ac2b-cb75112dfd37 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:28.068545 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-68856520-6e3b-4620-ac2b-cb75112dfd37 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:28.069244 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-68856520-6e3b-4620-ac2b-cb75112dfd37 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:28.234817 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-68856520-6e3b-4620-ac2b-cb75112dfd37 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:28.244883 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-68856520-6e3b-4620-ac2b-cb75112dfd37 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1366 microversion: 2.1 time: 0.191675 Aug 30 01:15:28.249764 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 362/686] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:28 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:28.796523 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b253bc85-3cd9-436a-adb1-9b5ad6abd90d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:28.797890 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b253bc85-3cd9-436a-adb1-9b5ad6abd90d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:28.810006 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b253bc85-3cd9-436a-adb1-9b5ad6abd90d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:28.815026 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b253bc85-3cd9-436a-adb1-9b5ad6abd90d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:28.815634 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b253bc85-3cd9-436a-adb1-9b5ad6abd90d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:28.816459 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b253bc85-3cd9-436a-adb1-9b5ad6abd90d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:28.817027 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b253bc85-3cd9-436a-adb1-9b5ad6abd90d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:28.817552 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b253bc85-3cd9-436a-adb1-9b5ad6abd90d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:29.004757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b253bc85-3cd9-436a-adb1-9b5ad6abd90d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:29.021959 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b253bc85-3cd9-436a-adb1-9b5ad6abd90d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1729 microversion: 2.1 time: 0.229263 Aug 30 01:15:29.043739 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-173a13a3-3a70-4065-84ab-504d55247661 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:29.044912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-173a13a3-3a70-4065-84ab-504d55247661 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:29.048975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 325/687] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:28 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1729 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:29.052538 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-173a13a3-3a70-4065-84ab-504d55247661 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:29.053285 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-173a13a3-3a70-4065-84ab-504d55247661 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:29.053972 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-173a13a3-3a70-4065-84ab-504d55247661 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:29.054902 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-173a13a3-3a70-4065-84ab-504d55247661 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:29.056598 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-173a13a3-3a70-4065-84ab-504d55247661 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:29.057707 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-173a13a3-3a70-4065-84ab-504d55247661 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:29.155180 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4560be85-8a8a-4d04-a14d-3df149973bd9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:29.155180 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4560be85-8a8a-4d04-a14d-3df149973bd9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:29.158025 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4560be85-8a8a-4d04-a14d-3df149973bd9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:29.158524 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4560be85-8a8a-4d04-a14d-3df149973bd9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:29.158966 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4560be85-8a8a-4d04-a14d-3df149973bd9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:29.159673 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4560be85-8a8a-4d04-a14d-3df149973bd9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:29.160132 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4560be85-8a8a-4d04-a14d-3df149973bd9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:29.160559 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4560be85-8a8a-4d04-a14d-3df149973bd9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:29.202513 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4560be85-8a8a-4d04-a14d-3df149973bd9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058252 Aug 30 01:15:29.209083 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 326/688] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:15:29 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 01:15:29.226897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-173a13a3-3a70-4065-84ab-504d55247661 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.186367 Aug 30 01:15:29.239609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 363/689] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 30 01:15:29 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:29.269290 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ec2e06a9-44dd-4406-9271-bf853b7958f3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:29.270103 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ec2e06a9-44dd-4406-9271-bf853b7958f3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:29.280424 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec2e06a9-44dd-4406-9271-bf853b7958f3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:29.280932 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec2e06a9-44dd-4406-9271-bf853b7958f3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:29.283898 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec2e06a9-44dd-4406-9271-bf853b7958f3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:29.284932 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec2e06a9-44dd-4406-9271-bf853b7958f3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:29.288884 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2da2f83e-0f77-47f4-b728-1436ec950eba tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:29.289508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec2e06a9-44dd-4406-9271-bf853b7958f3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:29.290033 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec2e06a9-44dd-4406-9271-bf853b7958f3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:29.290813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2da2f83e-0f77-47f4-b728-1436ec950eba tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:29.304433 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2da2f83e-0f77-47f4-b728-1436ec950eba tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:29.306337 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2da2f83e-0f77-47f4-b728-1436ec950eba tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:29.307037 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2da2f83e-0f77-47f4-b728-1436ec950eba tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:29.308992 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2da2f83e-0f77-47f4-b728-1436ec950eba tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:29.311759 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2da2f83e-0f77-47f4-b728-1436ec950eba tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:29.312748 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2da2f83e-0f77-47f4-b728-1436ec950eba tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:29.347202 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:29.378582 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2da2f83e-0f77-47f4-b728-1436ec950eba tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Going to try to terminate instance {{(pid=121233) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:15:29.785157 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ec2e06a9-44dd-4406-9271-bf853b7958f3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:29.797156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ec2e06a9-44dd-4406-9271-bf853b7958f3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1366 microversion: 2.1 time: 0.532128 Aug 30 01:15:29.800896 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 327/690] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:29 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1366 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:29.927334 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2da2f83e-0f77-47f4-b728-1436ec950eba tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 204 len: 0 microversion: 2.1 time: 0.642632 Aug 30 01:15:29.928219 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 364/691] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:15:29 2022] DELETE /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 01:15:29.936564 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f252457d-cc0f-4781-bdfc-85b1f1ba17e0 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:29.937177 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f252457d-cc0f-4781-bdfc-85b1f1ba17e0 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:29.944804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f252457d-cc0f-4781-bdfc-85b1f1ba17e0 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:29.945626 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f252457d-cc0f-4781-bdfc-85b1f1ba17e0 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:29.946631 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f252457d-cc0f-4781-bdfc-85b1f1ba17e0 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:29.947747 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f252457d-cc0f-4781-bdfc-85b1f1ba17e0 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:29.948344 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f252457d-cc0f-4781-bdfc-85b1f1ba17e0 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:29.948986 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f252457d-cc0f-4781-bdfc-85b1f1ba17e0 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:30.250004 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f252457d-cc0f-4781-bdfc-85b1f1ba17e0 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:30.259969 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f252457d-cc0f-4781-bdfc-85b1f1ba17e0 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1673 microversion: 2.1 time: 0.327177 Aug 30 01:15:30.266205 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 328/692] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:29 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1673 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:30.286518 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-872bd48c-3f2a-4e74-ba57-32e6ffeae81a req-f6d2b702-449c-4da8-b8dd-3275d6e186e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81845d9a-a800-4e7a-8edd-7d6329dd6db2", "name": "network-vif-plugged", "status": "completed", "tag": "ebd82af4-7bf6-4f28-91c9-b9f6fc86225c"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:30.299421 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-872bd48c-3f2a-4e74-ba57-32e6ffeae81a req-f6d2b702-449c-4da8-b8dd-3275d6e186e0 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:30.300244 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-872bd48c-3f2a-4e74-ba57-32e6ffeae81a req-f6d2b702-449c-4da8-b8dd-3275d6e186e0 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:30.300911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-872bd48c-3f2a-4e74-ba57-32e6ffeae81a req-f6d2b702-449c-4da8-b8dd-3275d6e186e0 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:30.315169 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-872bd48c-3f2a-4e74-ba57-32e6ffeae81a req-f6d2b702-449c-4da8-b8dd-3275d6e186e0 service nova] Creating event network-vif-plugged:ebd82af4-7bf6-4f28-91c9-b9f6fc86225c for instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 on hv-cinder-81571 Aug 30 01:15:30.320572 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-872bd48c-3f2a-4e74-ba57-32e6ffeae81a req-f6d2b702-449c-4da8-b8dd-3275d6e186e0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038886 Aug 30 01:15:30.322320 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 365/693] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:30.654504 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1481678224", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6de2f2e9-71f3-49c9-a223-f1fb974d9e7f"}], "security_groups": [{"name": "tempest-securitygroup--872557378"}], "key_name": "tempest-keypair-539486766", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:30.764738 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d95e46e9-a975-4475-ad04-8d166f159b4f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Action: 'create', calling method: .version_select at 0x7fd71d040160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-298168218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxYNXUp8kUDkJvLh65uUyMT0FsGuXsdtIljH5HICVBMIJurMvS57NGSMNc427JZ29VpuI/jL47LFheS0E2981J46EdH3udhDWTIZKhdFl5H4OfoaiCJD+MWeadkFcfWoQ=="}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:30.784157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-d95e46e9-a975-4475-ad04-8d166f159b4f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Getting quotas for project c6f3997439524d4583ece79273a55da4. Resources: {'key_pairs'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:15:30.786403 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-d95e46e9-a975-4475-ad04-8d166f159b4f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Getting quotas for user fdf94212f7654ff396be6dc2c2ca4874 and project c6f3997439524d4583ece79273a55da4. Resources: {'key_pairs'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:15:30.807238 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] validate_networks() for [('6de2f2e9-71f3-49c9-a223-f1fb974d9e7f', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:15:30.860408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d95e46e9-a975-4475-ad04-8d166f159b4f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.100053 Aug 30 01:15:30.861226 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 366/694] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 30 01:15:30 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:15:30.866983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-217f74e3-1502-4910-9378-d52152d95eaa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:30.868584 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-217f74e3-1502-4910-9378-d52152d95eaa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:30.878186 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-217f74e3-1502-4910-9378-d52152d95eaa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:30.879288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-217f74e3-1502-4910-9378-d52152d95eaa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:30.880054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-217f74e3-1502-4910-9378-d52152d95eaa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:30.880868 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-217f74e3-1502-4910-9378-d52152d95eaa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:30.881477 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-217f74e3-1502-4910-9378-d52152d95eaa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:30.882078 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-217f74e3-1502-4910-9378-d52152d95eaa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:31.034105 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-217f74e3-1502-4910-9378-d52152d95eaa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:31.044293 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-217f74e3-1502-4910-9378-d52152d95eaa tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1366 microversion: 2.1 time: 0.181791 Aug 30 01:15:31.045138 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 367/695] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:30 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:31.050195 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-296775168", "imageRef": "db56c52d-0f2a-4d20-8eba-9fcb3aad9086", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-298168218", "networks": [{"uuid": "3e3aa239-27df-4a3b-a034-6b3cd1db6e9f"}]}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:31.119953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.network.neutron [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] validate_networks() for [('3e3aa239-27df-4a3b-a034-6b3cd1db6e9f', None, None, None, None, None)] {{(pid=121233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:15:31.379210 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:15:31.379859 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:15:31.380598 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:15:31.381151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:15:31.381567 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:15:31.392680 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:31.393270 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:31.393810 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:31.394626 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:31.395081 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:31.395506 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:31.416046 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Getting quotas for project 742c089b0dea4b1f89efd31f48f9ffc5. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:15:31.421095 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Getting quotas for user 2ffe5c7cb44f476e913d64003105002c and project 742c089b0dea4b1f89efd31f48f9ffc5. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:15:31.433852 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:15:31.436181 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:15:31.558098 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Flavor limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:15:31.559894 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Image limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:15:31.560578 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Flavor pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:15:31.564365 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Image pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:15:31.564365 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:15:31.573748 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:31.574237 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:31.574917 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:31.575943 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:31.576792 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:31.577377 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:31.583433 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2ff594e4-b19f-4d43-859a-fa8a0d29e273 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.933534 Aug 30 01:15:31.584254 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 329/696] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Aug 30 01:15:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 01:15:31.597436 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Getting quotas for project c6f3997439524d4583ece79273a55da4. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:15:31.598645 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-ca4b72f3-6be0-40ff-8675-18ae959af80a req-718c8373-f7c6-4765-b676-519709973d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc62a7d-bbdb-4131-b8bc-ab85635ad17d", "tag": "074c3418-a64e-4b71-96d8-7600e741330d"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:31.621127 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Getting quotas for user fdf94212f7654ff396be6dc2c2ca4874 and project c6f3997439524d4583ece79273a55da4. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:15:31.623036 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ca4b72f3-6be0-40ff-8675-18ae959af80a req-718c8373-f7c6-4765-b676-519709973d7a service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:31.623517 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ca4b72f3-6be0-40ff-8675-18ae959af80a req-718c8373-f7c6-4765-b676-519709973d7a service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:31.623945 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ca4b72f3-6be0-40ff-8675-18ae959af80a req-718c8373-f7c6-4765-b676-519709973d7a service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:31.635674 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-ca4b72f3-6be0-40ff-8675-18ae959af80a req-718c8373-f7c6-4765-b676-519709973d7a service nova] Creating event network-changed:074c3418-a64e-4b71-96d8-7600e741330d for instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d on hv-cinder-81571 Aug 30 01:15:31.637132 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Going to run 1 instances... {{(pid=121233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:15:31.639599 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db56c52d-0f2a-4d20-8eba-9fcb3aad9086',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:15:31.642000 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-ca4b72f3-6be0-40ff-8675-18ae959af80a req-718c8373-f7c6-4765-b676-519709973d7a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046896 Aug 30 01:15:31.642801 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 330/697] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:31.648127 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5bb5e002-4b7d-46ef-a7f0-fff0b0cb7b15 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:31.649092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5bb5e002-4b7d-46ef-a7f0-fff0b0cb7b15 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:31.656215 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bb5e002-4b7d-46ef-a7f0-fff0b0cb7b15 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:31.657096 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bb5e002-4b7d-46ef-a7f0-fff0b0cb7b15 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:31.657096 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bb5e002-4b7d-46ef-a7f0-fff0b0cb7b15 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:31.657855 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bb5e002-4b7d-46ef-a7f0-fff0b0cb7b15 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:31.658311 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bb5e002-4b7d-46ef-a7f0-fff0b0cb7b15 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:31.658738 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bb5e002-4b7d-46ef-a7f0-fff0b0cb7b15 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:31.786272 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-b807e98b-2d32-4854-8ead-62953f7d5424 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739742 Aug 30 01:15:31.787932 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 368/698] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:15:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:15:31.797083 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-66860b55-6a1c-4b5b-9ab2-7ce76b752397 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:31.797864 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-66860b55-6a1c-4b5b-9ab2-7ce76b752397 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:31.838906 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5bb5e002-4b7d-46ef-a7f0-fff0b0cb7b15 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:31.847638 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5bb5e002-4b7d-46ef-a7f0-fff0b0cb7b15 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1673 microversion: 2.1 time: 0.203496 Aug 30 01:15:31.849273 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 331/699] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:31 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1673 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:31.856720 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-272947e0-1d8c-4cfe-a352-fbcaa9b71ac5 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:31.860735 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-272947e0-1d8c-4cfe-a352-fbcaa9b71ac5 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:31.864909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-66860b55-6a1c-4b5b-9ab2-7ce76b752397 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:31.875127 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-66860b55-6a1c-4b5b-9ab2-7ce76b752397 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:31.876674 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-66860b55-6a1c-4b5b-9ab2-7ce76b752397 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:31.877911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-66860b55-6a1c-4b5b-9ab2-7ce76b752397 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1281 microversion: 2.20 time: 0.088938 Aug 30 01:15:31.889759 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 369/700] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:31 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1281 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:31.928218 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-272947e0-1d8c-4cfe-a352-fbcaa9b71ac5 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:31.935801 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-272947e0-1d8c-4cfe-a352-fbcaa9b71ac5 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1257 microversion: 2.1 time: 0.084832 Aug 30 01:15:31.941065 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 332/701] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:31 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1257 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:32.067160 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b927dc94-e2a1-4ab6-bc53-68c7a60b5493 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:32.067906 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b927dc94-e2a1-4ab6-bc53-68c7a60b5493 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:32.075357 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b927dc94-e2a1-4ab6-bc53-68c7a60b5493 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:32.075852 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b927dc94-e2a1-4ab6-bc53-68c7a60b5493 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:32.078312 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b927dc94-e2a1-4ab6-bc53-68c7a60b5493 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:32.078312 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b927dc94-e2a1-4ab6-bc53-68c7a60b5493 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:32.078312 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b927dc94-e2a1-4ab6-bc53-68c7a60b5493 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:32.078312 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b927dc94-e2a1-4ab6-bc53-68c7a60b5493 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:32.254072 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-b927dc94-e2a1-4ab6-bc53-68c7a60b5493 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:32.267574 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-b927dc94-e2a1-4ab6-bc53-68c7a60b5493 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1366 microversion: 2.1 time: 0.203882 Aug 30 01:15:32.268222 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 370/702] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:32 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:32.874478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-afaee60d-0d54-4762-8b03-738f88da6ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:32.875156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-afaee60d-0d54-4762-8b03-738f88da6ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:32.881545 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afaee60d-0d54-4762-8b03-738f88da6ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:32.882122 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afaee60d-0d54-4762-8b03-738f88da6ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:32.882569 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afaee60d-0d54-4762-8b03-738f88da6ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:32.884038 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afaee60d-0d54-4762-8b03-738f88da6ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:32.884897 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afaee60d-0d54-4762-8b03-738f88da6ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:32.885002 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afaee60d-0d54-4762-8b03-738f88da6ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:32.901300 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d06c5b0e-aa74-49be-8441-51365d26ba58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:32.901969 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d06c5b0e-aa74-49be-8441-51365d26ba58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:32.909486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d06c5b0e-aa74-49be-8441-51365d26ba58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:32.909486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d06c5b0e-aa74-49be-8441-51365d26ba58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:32.909916 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d06c5b0e-aa74-49be-8441-51365d26ba58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:32.910555 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d06c5b0e-aa74-49be-8441-51365d26ba58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:32.911011 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d06c5b0e-aa74-49be-8441-51365d26ba58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:32.911449 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d06c5b0e-aa74-49be-8441-51365d26ba58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:32.981388 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d06c5b0e-aa74-49be-8441-51365d26ba58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:32.990382 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d06c5b0e-aa74-49be-8441-51365d26ba58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:32.991847 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d06c5b0e-aa74-49be-8441-51365d26ba58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:32.994743 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d06c5b0e-aa74-49be-8441-51365d26ba58 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1285 microversion: 2.20 time: 0.096981 Aug 30 01:15:32.996583 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 371/703] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:32 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:33.000137 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a526574a-1dbe-4783-a28b-86b46b74082f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:33.000745 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a526574a-1dbe-4783-a28b-86b46b74082f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:33.053919 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a526574a-1dbe-4783-a28b-86b46b74082f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:33.062155 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a526574a-1dbe-4783-a28b-86b46b74082f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1257 microversion: 2.1 time: 0.065232 Aug 30 01:15:33.062739 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 372/704] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:32 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:33.162212 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-afaee60d-0d54-4762-8b03-738f88da6ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:33.171622 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-afaee60d-0d54-4762-8b03-738f88da6ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1673 microversion: 2.1 time: 0.300949 Aug 30 01:15:33.172275 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 333/705] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:32 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1673 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:33.288476 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f0ff6d36-3469-496a-88a8-e4e30831e60c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:33.289092 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f0ff6d36-3469-496a-88a8-e4e30831e60c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:33.296385 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0ff6d36-3469-496a-88a8-e4e30831e60c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:33.296869 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0ff6d36-3469-496a-88a8-e4e30831e60c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:33.297304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0ff6d36-3469-496a-88a8-e4e30831e60c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:33.298334 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0ff6d36-3469-496a-88a8-e4e30831e60c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:33.299001 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0ff6d36-3469-496a-88a8-e4e30831e60c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:33.299482 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0ff6d36-3469-496a-88a8-e4e30831e60c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:33.446882 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f0ff6d36-3469-496a-88a8-e4e30831e60c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:33.455771 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f0ff6d36-3469-496a-88a8-e4e30831e60c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1366 microversion: 2.1 time: 0.171134 Aug 30 01:15:33.456677 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 373/706] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:33 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:33.713277 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-7235c285-e6aa-4f9a-afc4-7f773cce3e2f req-104b3a22-89e1-469a-8e7b-e4e885933677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc62a7d-bbdb-4131-b8bc-ab85635ad17d", "tag": "074c3418-a64e-4b71-96d8-7600e741330d"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:33.728066 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-7235c285-e6aa-4f9a-afc4-7f773cce3e2f req-104b3a22-89e1-469a-8e7b-e4e885933677 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:33.728859 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-7235c285-e6aa-4f9a-afc4-7f773cce3e2f req-104b3a22-89e1-469a-8e7b-e4e885933677 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:33.729296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-7235c285-e6aa-4f9a-afc4-7f773cce3e2f req-104b3a22-89e1-469a-8e7b-e4e885933677 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:33.746506 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-7235c285-e6aa-4f9a-afc4-7f773cce3e2f req-104b3a22-89e1-469a-8e7b-e4e885933677 service nova] Creating event network-changed:074c3418-a64e-4b71-96d8-7600e741330d for instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d on hv-cinder-81571 Aug 30 01:15:33.752941 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-7235c285-e6aa-4f9a-afc4-7f773cce3e2f req-104b3a22-89e1-469a-8e7b-e4e885933677 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043599 Aug 30 01:15:33.754407 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 334/707] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:34.018563 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-be030e23-7340-499f-b3f7-00b8511e6bff tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:34.019336 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-be030e23-7340-499f-b3f7-00b8511e6bff tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:34.026119 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-be030e23-7340-499f-b3f7-00b8511e6bff tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:34.026605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-be030e23-7340-499f-b3f7-00b8511e6bff tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:34.027038 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-be030e23-7340-499f-b3f7-00b8511e6bff tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:34.027844 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-be030e23-7340-499f-b3f7-00b8511e6bff tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:34.028305 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-be030e23-7340-499f-b3f7-00b8511e6bff tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:34.028731 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-be030e23-7340-499f-b3f7-00b8511e6bff tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:34.084374 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-343fe997-c01d-485f-aa53-2d026dcb99fb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:34.085080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-343fe997-c01d-485f-aa53-2d026dcb99fb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:34.093078 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-be030e23-7340-499f-b3f7-00b8511e6bff tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:34.094449 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-343fe997-c01d-485f-aa53-2d026dcb99fb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:34.094947 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-343fe997-c01d-485f-aa53-2d026dcb99fb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:34.095395 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-343fe997-c01d-485f-aa53-2d026dcb99fb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:34.096123 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-343fe997-c01d-485f-aa53-2d026dcb99fb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:34.096745 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-343fe997-c01d-485f-aa53-2d026dcb99fb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:34.097379 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-343fe997-c01d-485f-aa53-2d026dcb99fb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:34.104392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-be030e23-7340-499f-b3f7-00b8511e6bff tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:34.105998 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-be030e23-7340-499f-b3f7-00b8511e6bff tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:34.107205 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-be030e23-7340-499f-b3f7-00b8511e6bff tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1277 microversion: 2.20 time: 0.092603 Aug 30 01:15:34.107997 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 374/708] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:34 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:34.162171 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-343fe997-c01d-485f-aa53-2d026dcb99fb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:34.170829 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-343fe997-c01d-485f-aa53-2d026dcb99fb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1253 microversion: 2.1 time: 0.090894 Aug 30 01:15:34.171408 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 335/709] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:34 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1253 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:34.193692 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5aea1a16-cd0b-45be-b523-0ee9457ff1ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:34.194298 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5aea1a16-cd0b-45be-b523-0ee9457ff1ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:34.200630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5aea1a16-cd0b-45be-b523-0ee9457ff1ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:34.201109 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5aea1a16-cd0b-45be-b523-0ee9457ff1ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:34.201538 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5aea1a16-cd0b-45be-b523-0ee9457ff1ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:34.202255 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5aea1a16-cd0b-45be-b523-0ee9457ff1ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:34.202703 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5aea1a16-cd0b-45be-b523-0ee9457ff1ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:34.203120 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5aea1a16-cd0b-45be-b523-0ee9457ff1ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:34.207300 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:34.278711 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5aea1a16-cd0b-45be-b523-0ee9457ff1ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:34.287177 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5aea1a16-cd0b-45be-b523-0ee9457ff1ad tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1605 microversion: 2.1 time: 0.097208 Aug 30 01:15:34.287921 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 375/710] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:34 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1605 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:34.477796 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5ac18300-5f5c-40d3-a049-11087597c878 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:34.478316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5ac18300-5f5c-40d3-a049-11087597c878 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:34.488245 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ac18300-5f5c-40d3-a049-11087597c878 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:34.488793 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ac18300-5f5c-40d3-a049-11087597c878 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:34.489414 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ac18300-5f5c-40d3-a049-11087597c878 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:34.491028 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ac18300-5f5c-40d3-a049-11087597c878 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:34.491495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ac18300-5f5c-40d3-a049-11087597c878 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:34.491930 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ac18300-5f5c-40d3-a049-11087597c878 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:34.732059 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5ac18300-5f5c-40d3-a049-11087597c878 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:34.740460 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5ac18300-5f5c-40d3-a049-11087597c878 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1366 microversion: 2.1 time: 0.266824 Aug 30 01:15:34.754160 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 336/711] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:34 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:35.131840 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-53a683ce-8628-4797-8148-3155e6a20176 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:35.133153 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-53a683ce-8628-4797-8148-3155e6a20176 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:35.146977 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-53a683ce-8628-4797-8148-3155e6a20176 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:35.147772 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-53a683ce-8628-4797-8148-3155e6a20176 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:35.149291 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-53a683ce-8628-4797-8148-3155e6a20176 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:35.151664 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-53a683ce-8628-4797-8148-3155e6a20176 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:35.153818 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-53a683ce-8628-4797-8148-3155e6a20176 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:35.154429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-53a683ce-8628-4797-8148-3155e6a20176 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:35.203288 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-50937509-00ee-46cb-a63a-9226d1d3353b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:35.203288 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-50937509-00ee-46cb-a63a-9226d1d3353b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:35.204710 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50937509-00ee-46cb-a63a-9226d1d3353b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:35.206381 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50937509-00ee-46cb-a63a-9226d1d3353b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:35.208312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50937509-00ee-46cb-a63a-9226d1d3353b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:35.210289 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50937509-00ee-46cb-a63a-9226d1d3353b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:35.213445 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50937509-00ee-46cb-a63a-9226d1d3353b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:35.216163 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50937509-00ee-46cb-a63a-9226d1d3353b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:35.238516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-53a683ce-8628-4797-8148-3155e6a20176 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:35.252440 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-53a683ce-8628-4797-8148-3155e6a20176 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:35.252440 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-53a683ce-8628-4797-8148-3155e6a20176 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:35.253013 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-53a683ce-8628-4797-8148-3155e6a20176 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1333 microversion: 2.20 time: 0.125715 Aug 30 01:15:35.258954 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 376/712] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:35 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1333 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:35.299091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-50937509-00ee-46cb-a63a-9226d1d3353b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:35.309259 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2e3fb73f-9e3d-44f7-afd9-cf85ee00ea05 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:35.310213 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2e3fb73f-9e3d-44f7-afd9-cf85ee00ea05 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:35.314755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-50937509-00ee-46cb-a63a-9226d1d3353b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1309 microversion: 2.1 time: 0.125761 Aug 30 01:15:35.315857 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 337/713] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:35 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:35.330772 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e3fb73f-9e3d-44f7-afd9-cf85ee00ea05 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:35.331504 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e3fb73f-9e3d-44f7-afd9-cf85ee00ea05 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:35.332166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e3fb73f-9e3d-44f7-afd9-cf85ee00ea05 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:35.333408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e3fb73f-9e3d-44f7-afd9-cf85ee00ea05 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:35.333977 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e3fb73f-9e3d-44f7-afd9-cf85ee00ea05 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:35.334420 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e3fb73f-9e3d-44f7-afd9-cf85ee00ea05 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:35.369209 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e3fb73f-9e3d-44f7-afd9-cf85ee00ea05 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:35.369695 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e3fb73f-9e3d-44f7-afd9-cf85ee00ea05 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:35.370152 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e3fb73f-9e3d-44f7-afd9-cf85ee00ea05 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:35.370615 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-2e3fb73f-9e3d-44f7-afd9-cf85ee00ea05 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lazy-loading 'fault' on Instance uuid 5022a2c4-6b00-416c-9a13-63b0dec702b2 {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:15:35.411243 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2e3fb73f-9e3d-44f7-afd9-cf85ee00ea05 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:35.420806 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2e3fb73f-9e3d-44f7-afd9-cf85ee00ea05 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1328 microversion: 2.1 time: 0.115855 Aug 30 01:15:35.421381 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 377/714] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:35 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1328 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:35.761164 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ba992526-6aad-4a71-b083-3f4a5df80f07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:35.761871 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ba992526-6aad-4a71-b083-3f4a5df80f07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:35.768049 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba992526-6aad-4a71-b083-3f4a5df80f07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:35.771684 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba992526-6aad-4a71-b083-3f4a5df80f07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:35.771684 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba992526-6aad-4a71-b083-3f4a5df80f07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:35.771875 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-619d4895-1c1f-4119-a414-ecc6ec7b07ef req-18577b0d-9a5c-4a2d-b765-d2e5ed8bb5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5022a2c4-6b00-416c-9a13-63b0dec702b2", "name": "network-vif-deleted", "tag": "c67f9947-1307-4c65-b66d-e90b9d577330"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:35.771980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba992526-6aad-4a71-b083-3f4a5df80f07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:35.771980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba992526-6aad-4a71-b083-3f4a5df80f07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:35.771980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba992526-6aad-4a71-b083-3f4a5df80f07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:35.779203 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-619d4895-1c1f-4119-a414-ecc6ec7b07ef req-18577b0d-9a5c-4a2d-b765-d2e5ed8bb5b3 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:35.779676 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-619d4895-1c1f-4119-a414-ecc6ec7b07ef req-18577b0d-9a5c-4a2d-b765-d2e5ed8bb5b3 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:35.780106 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-619d4895-1c1f-4119-a414-ecc6ec7b07ef req-18577b0d-9a5c-4a2d-b765-d2e5ed8bb5b3 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:35.791661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-619d4895-1c1f-4119-a414-ecc6ec7b07ef req-18577b0d-9a5c-4a2d-b765-d2e5ed8bb5b3 service nova] Creating event network-vif-deleted:c67f9947-1307-4c65-b66d-e90b9d577330 for instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 on hv-cinder-81571 Aug 30 01:15:35.796940 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-619d4895-1c1f-4119-a414-ecc6ec7b07ef req-18577b0d-9a5c-4a2d-b765-d2e5ed8bb5b3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031054 Aug 30 01:15:35.797538 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 378/715] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:35.908057 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ba992526-6aad-4a71-b083-3f4a5df80f07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:35.917653 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ba992526-6aad-4a71-b083-3f4a5df80f07 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1556 microversion: 2.1 time: 0.160756 Aug 30 01:15:35.918273 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 338/716] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:35 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:35.942765 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a365ba3d-b0d4-45e8-aa3a-fac19e34c11f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:35.943366 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a365ba3d-b0d4-45e8-aa3a-fac19e34c11f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:35.950288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a365ba3d-b0d4-45e8-aa3a-fac19e34c11f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:35.950768 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a365ba3d-b0d4-45e8-aa3a-fac19e34c11f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:35.951206 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a365ba3d-b0d4-45e8-aa3a-fac19e34c11f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:35.951910 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a365ba3d-b0d4-45e8-aa3a-fac19e34c11f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:35.952363 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a365ba3d-b0d4-45e8-aa3a-fac19e34c11f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:35.952788 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a365ba3d-b0d4-45e8-aa3a-fac19e34c11f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:36.030846 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a365ba3d-b0d4-45e8-aa3a-fac19e34c11f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096520 Aug 30 01:15:36.035176 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 379/717] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 30 01:15:35 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:36.277668 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-26bb46ad-6ce0-4343-b752-bd2a498340f0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:36.278293 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-26bb46ad-6ce0-4343-b752-bd2a498340f0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:36.285415 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26bb46ad-6ce0-4343-b752-bd2a498340f0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:36.286163 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26bb46ad-6ce0-4343-b752-bd2a498340f0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:36.286641 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26bb46ad-6ce0-4343-b752-bd2a498340f0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:36.287348 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26bb46ad-6ce0-4343-b752-bd2a498340f0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:36.287990 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26bb46ad-6ce0-4343-b752-bd2a498340f0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:36.288411 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26bb46ad-6ce0-4343-b752-bd2a498340f0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:36.338236 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-52d56018-94fb-4a71-b6e4-e45cd305029f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:36.338858 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-52d56018-94fb-4a71-b6e4-e45cd305029f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:36.344959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-52d56018-94fb-4a71-b6e4-e45cd305029f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:36.345442 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-52d56018-94fb-4a71-b6e4-e45cd305029f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:36.345939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-52d56018-94fb-4a71-b6e4-e45cd305029f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:36.346645 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-52d56018-94fb-4a71-b6e4-e45cd305029f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:36.347152 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-52d56018-94fb-4a71-b6e4-e45cd305029f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:36.347619 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-52d56018-94fb-4a71-b6e4-e45cd305029f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:36.390436 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-26bb46ad-6ce0-4343-b752-bd2a498340f0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:36.403117 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-26bb46ad-6ce0-4343-b752-bd2a498340f0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:36.404774 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-26bb46ad-6ce0-4343-b752-bd2a498340f0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:36.406176 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-26bb46ad-6ce0-4343-b752-bd2a498340f0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1341 microversion: 2.20 time: 0.133352 Aug 30 01:15:36.409651 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 339/718] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:36 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1341 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:36.412316 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-52d56018-94fb-4a71-b6e4-e45cd305029f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:36.421205 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-52d56018-94fb-4a71-b6e4-e45cd305029f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1309 microversion: 2.1 time: 0.088353 Aug 30 01:15:36.422282 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 380/719] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:36 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1309 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:36.447993 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a6fb3dc6-1116-4fd3-8284-76322e867c3c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:36.448599 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a6fb3dc6-1116-4fd3-8284-76322e867c3c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:36.462374 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6fb3dc6-1116-4fd3-8284-76322e867c3c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:36.462374 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6fb3dc6-1116-4fd3-8284-76322e867c3c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:36.462374 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6fb3dc6-1116-4fd3-8284-76322e867c3c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:36.462374 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6fb3dc6-1116-4fd3-8284-76322e867c3c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:36.463180 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6fb3dc6-1116-4fd3-8284-76322e867c3c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:36.463180 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6fb3dc6-1116-4fd3-8284-76322e867c3c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:36.509103 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6fb3dc6-1116-4fd3-8284-76322e867c3c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:36.509696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6fb3dc6-1116-4fd3-8284-76322e867c3c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:36.510369 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6fb3dc6-1116-4fd3-8284-76322e867c3c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:36.510904 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-a6fb3dc6-1116-4fd3-8284-76322e867c3c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lazy-loading 'fault' on Instance uuid 5022a2c4-6b00-416c-9a13-63b0dec702b2 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:15:36.589339 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a6fb3dc6-1116-4fd3-8284-76322e867c3c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:36.597331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a6fb3dc6-1116-4fd3-8284-76322e867c3c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 200 len: 1328 microversion: 2.1 time: 0.153735 Aug 30 01:15:36.597952 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 340/720] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:36 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 1328 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:37.440867 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-509646bb-1824-4013-bc74-c334f08209f6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:37.441630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-509646bb-1824-4013-bc74-c334f08209f6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:37.450062 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-509646bb-1824-4013-bc74-c334f08209f6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:37.450271 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-20e48dd9-d9cc-4da4-8fce-6f738af25044 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:37.450705 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-509646bb-1824-4013-bc74-c334f08209f6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:37.451172 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-509646bb-1824-4013-bc74-c334f08209f6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:37.451941 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-509646bb-1824-4013-bc74-c334f08209f6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:37.452658 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-509646bb-1824-4013-bc74-c334f08209f6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:37.453180 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-509646bb-1824-4013-bc74-c334f08209f6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:37.454286 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-20e48dd9-d9cc-4da4-8fce-6f738af25044 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:37.460809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20e48dd9-d9cc-4da4-8fce-6f738af25044 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:37.461318 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20e48dd9-d9cc-4da4-8fce-6f738af25044 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:37.461804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20e48dd9-d9cc-4da4-8fce-6f738af25044 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:37.462491 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20e48dd9-d9cc-4da4-8fce-6f738af25044 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:37.463001 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20e48dd9-d9cc-4da4-8fce-6f738af25044 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:37.463345 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20e48dd9-d9cc-4da4-8fce-6f738af25044 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:37.579027 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-509646bb-1824-4013-bc74-c334f08209f6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:37.593116 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-509646bb-1824-4013-bc74-c334f08209f6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:37.595852 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-509646bb-1824-4013-bc74-c334f08209f6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:37.598153 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-509646bb-1824-4013-bc74-c334f08209f6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1339 microversion: 2.20 time: 0.160849 Aug 30 01:15:37.620462 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 381/721] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:37 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1339 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:37.631059 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2be52e71-f2eb-42bb-809b-21b7e721e2fa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:37.632071 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2be52e71-f2eb-42bb-809b-21b7e721e2fa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:37.639901 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2be52e71-f2eb-42bb-809b-21b7e721e2fa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:37.640978 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2be52e71-f2eb-42bb-809b-21b7e721e2fa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:37.641630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2be52e71-f2eb-42bb-809b-21b7e721e2fa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:37.643198 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2be52e71-f2eb-42bb-809b-21b7e721e2fa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:37.647483 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-20e48dd9-d9cc-4da4-8fce-6f738af25044 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:37.655578 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2be52e71-f2eb-42bb-809b-21b7e721e2fa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:37.658090 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2be52e71-f2eb-42bb-809b-21b7e721e2fa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:37.660690 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-20e48dd9-d9cc-4da4-8fce-6f738af25044 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1315 microversion: 2.1 time: 0.217275 Aug 30 01:15:37.665784 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 341/722] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:37 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:37.680934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-2be52e71-f2eb-42bb-809b-21b7e721e2fa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] HTTP exception thrown: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2be52e71-f2eb-42bb-809b-21b7e721e2fa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Request method failure captured: Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 HTTP/1.1 Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOcY192hneaWv-NPReFMbYw7mU-VvzMV4_D8OFt35mri1iXgTodRsBg3a-C_Pird-5DpPlRFWa6OmVdM4njhoSGrx83O5C7kcFrFakQQHMcnSw7dVa3PjBXf3eUyNKoq4T-0ymcTlQ6Ixftps3Fn1F8AaLwMtc9RDKX_4g86-ep5ck Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 13862ab3a9504644853a8c48c3f69b4c Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:15:37.682787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:15:37.684408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:15:37.684408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:15:37.684408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 13862ab3a9504644853a8c48c3f69b4c Aug 30 01:15:37.684408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:15:37.684408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-AttachVolumeTestJSON-1554932294-project Aug 30 01:15:37.684408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:15:37.684408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:15:37.684408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 90486e175bb2411b9f2adedf6e3ecac6 Aug 30 01:15:37.684408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-AttachVolumeTestJSON-1554932294-project Aug 30 01:15:37.684408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:15:37.684408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. Aug 30 01:15:37.684408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': '5022a2c4-6b00-416c-9a13-63b0dec702b2'} Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:15:37.685484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. Aug 30 01:15:37.687959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:15:37.692429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2be52e71-f2eb-42bb-809b-21b7e721e2fa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Returning 404 to user: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:15:37.693626 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2be52e71-f2eb-42bb-809b-21b7e721e2fa tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 404 len: 111 microversion: 2.1 time: 0.071431 Aug 30 01:15:37.697935 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 382/723] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:37 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:15:37.711489 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-41f56fe3-7407-4831-87e2-ae7f6837a909 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '.version_select at 0x7fd71d1549d0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:37.842398 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-41f56fe3-7407-4831-87e2-ae7f6837a909 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1276074389" status: 202 len: 0 microversion: 2.1 time: 0.139106 Aug 30 01:15:37.843339 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 342/724] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Aug 30 01:15:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1276074389 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:15:38.640494 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-90ef5f0c-8b5a-435d-88eb-8a01c6762910 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:38.641287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-90ef5f0c-8b5a-435d-88eb-8a01c6762910 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:38.662320 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-90ef5f0c-8b5a-435d-88eb-8a01c6762910 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:38.666174 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-90ef5f0c-8b5a-435d-88eb-8a01c6762910 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:38.671828 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-90ef5f0c-8b5a-435d-88eb-8a01c6762910 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:38.673869 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-90ef5f0c-8b5a-435d-88eb-8a01c6762910 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:38.675851 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-90ef5f0c-8b5a-435d-88eb-8a01c6762910 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:38.676600 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-90ef5f0c-8b5a-435d-88eb-8a01c6762910 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:38.693431 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b9c323dd-e7cc-4f99-922f-093e0edbfa25 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:38.696267 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b9c323dd-e7cc-4f99-922f-093e0edbfa25 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:38.720937 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9c323dd-e7cc-4f99-922f-093e0edbfa25 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:38.726794 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9c323dd-e7cc-4f99-922f-093e0edbfa25 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:38.727782 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9c323dd-e7cc-4f99-922f-093e0edbfa25 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:38.730618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9c323dd-e7cc-4f99-922f-093e0edbfa25 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:38.733109 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9c323dd-e7cc-4f99-922f-093e0edbfa25 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:38.737189 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b9c323dd-e7cc-4f99-922f-093e0edbfa25 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:38.891950 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b9c323dd-e7cc-4f99-922f-093e0edbfa25 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:38.905480 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b9c323dd-e7cc-4f99-922f-093e0edbfa25 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1315 microversion: 2.1 time: 0.217959 Aug 30 01:15:38.906515 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 343/725] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:38 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:38.923671 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-3272c740-3b46-42e2-a0f9-f02ef0dc9fa5 req-0662b001-ff07-4e2d-8305-e1b0af5f22e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81845d9a-a800-4e7a-8edd-7d6329dd6db2", "tag": "ebd82af4-7bf6-4f28-91c9-b9f6fc86225c"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:38.943214 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3272c740-3b46-42e2-a0f9-f02ef0dc9fa5 req-0662b001-ff07-4e2d-8305-e1b0af5f22e7 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:38.943692 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3272c740-3b46-42e2-a0f9-f02ef0dc9fa5 req-0662b001-ff07-4e2d-8305-e1b0af5f22e7 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:38.944124 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3272c740-3b46-42e2-a0f9-f02ef0dc9fa5 req-0662b001-ff07-4e2d-8305-e1b0af5f22e7 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:38.967830 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-3272c740-3b46-42e2-a0f9-f02ef0dc9fa5 req-0662b001-ff07-4e2d-8305-e1b0af5f22e7 service nova] Creating event network-changed:ebd82af4-7bf6-4f28-91c9-b9f6fc86225c for instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 on hv-cinder-81571 Aug 30 01:15:38.981990 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-3272c740-3b46-42e2-a0f9-f02ef0dc9fa5 req-0662b001-ff07-4e2d-8305-e1b0af5f22e7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074013 Aug 30 01:15:38.982838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 344/726] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:39.319461 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-90ef5f0c-8b5a-435d-88eb-8a01c6762910 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:39.333301 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-90ef5f0c-8b5a-435d-88eb-8a01c6762910 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:39.339713 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-90ef5f0c-8b5a-435d-88eb-8a01c6762910 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:39.341175 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-90ef5f0c-8b5a-435d-88eb-8a01c6762910 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.705802 Aug 30 01:15:39.356057 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 383/727] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:38 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:39.463534 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-016661c8-3bc6-47f1-b8a1-f35154527998 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Action: 'create', calling method: .version_select at 0x7fd71cf500d0>, body: {"keypair": {"name": "tempest-keypair-1609292028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+Vr+r3CkKhsu7266Rwt2MYIuLSktCKEMdKOYufve1/ndM42e7qsuFQ3iTtyahDJvr0dQxLOr8fRP8EYFDAycKgEumd5GyXj/qfJtpIMLtnVYfwA2X3QlgBiH9T60KFPQ=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:39.485355 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-016661c8-3bc6-47f1-b8a1-f35154527998 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Getting quotas for project 13862ab3a9504644853a8c48c3f69b4c. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:15:39.494410 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-016661c8-3bc6-47f1-b8a1-f35154527998 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Getting quotas for user 90486e175bb2411b9f2adedf6e3ecac6 and project 13862ab3a9504644853a8c48c3f69b4c. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:15:39.583127 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-016661c8-3bc6-47f1-b8a1-f35154527998 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126230 Aug 30 01:15:39.584727 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 345/728] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 30 01:15:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:15:39.928728 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d22f59ff-9a59-48ec-bf69-1c5549b709d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:39.929462 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d22f59ff-9a59-48ec-bf69-1c5549b709d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:39.945900 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d22f59ff-9a59-48ec-bf69-1c5549b709d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:39.946478 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d22f59ff-9a59-48ec-bf69-1c5549b709d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:39.947371 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d22f59ff-9a59-48ec-bf69-1c5549b709d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:39.948259 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d22f59ff-9a59-48ec-bf69-1c5549b709d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:39.948888 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d22f59ff-9a59-48ec-bf69-1c5549b709d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:39.949471 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d22f59ff-9a59-48ec-bf69-1c5549b709d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:40.247679 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d22f59ff-9a59-48ec-bf69-1c5549b709d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:40.268114 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d22f59ff-9a59-48ec-bf69-1c5549b709d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1357 microversion: 2.1 time: 0.342889 Aug 30 01:15:40.274842 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 384/729] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:39 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1357 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:40.369890 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bc51a7e0-d237-410a-a017-8cae91d3ae3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:40.372405 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bc51a7e0-d237-410a-a017-8cae91d3ae3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:40.392402 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc51a7e0-d237-410a-a017-8cae91d3ae3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:40.393202 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc51a7e0-d237-410a-a017-8cae91d3ae3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:40.393854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc51a7e0-d237-410a-a017-8cae91d3ae3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:40.394910 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc51a7e0-d237-410a-a017-8cae91d3ae3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:40.404579 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc51a7e0-d237-410a-a017-8cae91d3ae3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:40.404579 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc51a7e0-d237-410a-a017-8cae91d3ae3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:40.829916 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bc51a7e0-d237-410a-a017-8cae91d3ae3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:40.840412 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bc51a7e0-d237-410a-a017-8cae91d3ae3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:40.841891 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bc51a7e0-d237-410a-a017-8cae91d3ae3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:40.843217 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bc51a7e0-d237-410a-a017-8cae91d3ae3a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.478534 Aug 30 01:15:40.859173 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 346/730] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:40 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:41.088751 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-2e0fa298-da02-4a09-8cd7-c88ed528c5ba req-9f78e193-3008-4661-bb21-ab5d780c41a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65b743eb-1b3f-458d-ad48-d60c3934ba0d", "tag": "adb8f445-f2e5-41a5-91ba-43406b91be88"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:41.113830 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-2e0fa298-da02-4a09-8cd7-c88ed528c5ba req-9f78e193-3008-4661-bb21-ab5d780c41a7 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:41.115182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-2e0fa298-da02-4a09-8cd7-c88ed528c5ba req-9f78e193-3008-4661-bb21-ab5d780c41a7 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:41.115632 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-2e0fa298-da02-4a09-8cd7-c88ed528c5ba req-9f78e193-3008-4661-bb21-ab5d780c41a7 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:41.149525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-2e0fa298-da02-4a09-8cd7-c88ed528c5ba req-9f78e193-3008-4661-bb21-ab5d780c41a7 service nova] Creating event network-changed:adb8f445-f2e5-41a5-91ba-43406b91be88 for instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d on hv-cinder-81571 Aug 30 01:15:41.157022 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-2e0fa298-da02-4a09-8cd7-c88ed528c5ba req-9f78e193-3008-4661-bb21-ab5d780c41a7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072616 Aug 30 01:15:41.158530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 385/731] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:15:41.296039 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-653f32ce-981b-487b-9e2e-c4bf251c351c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:41.304491 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-653f32ce-981b-487b-9e2e-c4bf251c351c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:41.311964 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-653f32ce-981b-487b-9e2e-c4bf251c351c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:41.312844 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-653f32ce-981b-487b-9e2e-c4bf251c351c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:41.326577 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-653f32ce-981b-487b-9e2e-c4bf251c351c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:41.327625 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-653f32ce-981b-487b-9e2e-c4bf251c351c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:41.328182 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-653f32ce-981b-487b-9e2e-c4bf251c351c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:41.328685 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-653f32ce-981b-487b-9e2e-c4bf251c351c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:41.403238 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:41.577406 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-653f32ce-981b-487b-9e2e-c4bf251c351c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:41.587119 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-653f32ce-981b-487b-9e2e-c4bf251c351c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1357 microversion: 2.1 time: 0.294991 Aug 30 01:15:41.588132 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 347/732] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:41 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1357 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:41.863423 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=2 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:41.868833 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d0712d7f-b3ee-4a2c-971e-1d11ac1eead3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:41.870133 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d0712d7f-b3ee-4a2c-971e-1d11ac1eead3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:41.876946 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d0712d7f-b3ee-4a2c-971e-1d11ac1eead3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:41.877667 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d0712d7f-b3ee-4a2c-971e-1d11ac1eead3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:41.878352 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d0712d7f-b3ee-4a2c-971e-1d11ac1eead3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:41.879153 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d0712d7f-b3ee-4a2c-971e-1d11ac1eead3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:41.879676 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d0712d7f-b3ee-4a2c-971e-1d11ac1eead3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:41.880366 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d0712d7f-b3ee-4a2c-971e-1d11ac1eead3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:42.349746 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d0712d7f-b3ee-4a2c-971e-1d11ac1eead3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:42.360358 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d0712d7f-b3ee-4a2c-971e-1d11ac1eead3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:42.362167 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d0712d7f-b3ee-4a2c-971e-1d11ac1eead3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:42.363335 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d0712d7f-b3ee-4a2c-971e-1d11ac1eead3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.500879 Aug 30 01:15:42.363964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 386/733] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:41 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:42.609258 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-479bda72-236d-4d7e-aec4-f95506340dcb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:42.611418 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-479bda72-236d-4d7e-aec4-f95506340dcb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:42.621237 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-479bda72-236d-4d7e-aec4-f95506340dcb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:42.622152 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-479bda72-236d-4d7e-aec4-f95506340dcb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:42.622659 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-479bda72-236d-4d7e-aec4-f95506340dcb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:42.623704 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-479bda72-236d-4d7e-aec4-f95506340dcb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:42.623937 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-479bda72-236d-4d7e-aec4-f95506340dcb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:42.624461 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-479bda72-236d-4d7e-aec4-f95506340dcb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:42.853475 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-479bda72-236d-4d7e-aec4-f95506340dcb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:42.863669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-479bda72-236d-4d7e-aec4-f95506340dcb tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1357 microversion: 2.1 time: 0.258184 Aug 30 01:15:42.865773 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 348/734] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:42 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1357 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:42.956221 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1545640665", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37938639-da56-43d1-ac7c-a949da52ba53"}], "security_groups": [{"name": "tempest-securitygroup--392200257"}], "key_name": "tempest-keypair-1609292028", "user_data": "}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:43.060752 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=18 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:43.082410 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.network.neutron [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] validate_networks() for [('37938639-da56-43d1-ac7c-a949da52ba53', None, None, None, None, None)] {{(pid=121233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:15:43.173827 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-687b90cf-816f-48b2-95b5-7d9354ec4740 req-7c0e0ddb-c9e2-4f0d-9014-05895cccda2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfb98683-87f8-47ff-89d6-4d74e9f961d1", "tag": "fb9f85b8-7682-4117-938b-7225f55cd3b2"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:43.178725 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:43.185140 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-687b90cf-816f-48b2-95b5-7d9354ec4740 req-7c0e0ddb-c9e2-4f0d-9014-05895cccda2f service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:43.185899 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-687b90cf-816f-48b2-95b5-7d9354ec4740 req-7c0e0ddb-c9e2-4f0d-9014-05895cccda2f service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:43.186523 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-687b90cf-816f-48b2-95b5-7d9354ec4740 req-7c0e0ddb-c9e2-4f0d-9014-05895cccda2f service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:43.202240 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-687b90cf-816f-48b2-95b5-7d9354ec4740 req-7c0e0ddb-c9e2-4f0d-9014-05895cccda2f service nova] Creating event network-changed:fb9f85b8-7682-4117-938b-7225f55cd3b2 for instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 on hv-cinder-81571 Aug 30 01:15:43.207365 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-687b90cf-816f-48b2-95b5-7d9354ec4740 req-7c0e0ddb-c9e2-4f0d-9014-05895cccda2f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037217 Aug 30 01:15:43.208069 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 349/735] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:43.387765 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1f401c84-d43b-4a4e-be11-52dbfcebbb06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:43.388475 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1f401c84-d43b-4a4e-be11-52dbfcebbb06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:43.395692 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f401c84-d43b-4a4e-be11-52dbfcebbb06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:43.396178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f401c84-d43b-4a4e-be11-52dbfcebbb06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:43.396607 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f401c84-d43b-4a4e-be11-52dbfcebbb06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:43.397299 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f401c84-d43b-4a4e-be11-52dbfcebbb06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:43.397809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f401c84-d43b-4a4e-be11-52dbfcebbb06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:43.398197 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f401c84-d43b-4a4e-be11-52dbfcebbb06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:43.401361 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:43.520551 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Flavor limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:15:43.521338 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Image limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:15:43.522797 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Flavor pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:15:43.523219 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Image pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:15:43.523675 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:15:43.534962 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:43.535746 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:43.536375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:43.537990 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:43.538664 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:43.539357 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:43.562963 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Getting quotas for project 13862ab3a9504644853a8c48c3f69b4c. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:15:43.567794 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Getting quotas for user 90486e175bb2411b9f2adedf6e3ecac6 and project 13862ab3a9504644853a8c48c3f69b4c. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:15:43.573305 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:43.585070 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Going to run 1 instances... {{(pid=121233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:15:43.588604 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:15:43.676833 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1f401c84-d43b-4a4e-be11-52dbfcebbb06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:43.676833 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1f401c84-d43b-4a4e-be11-52dbfcebbb06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:43.677467 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1f401c84-d43b-4a4e-be11-52dbfcebbb06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:43.677467 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1f401c84-d43b-4a4e-be11-52dbfcebbb06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.227297 Aug 30 01:15:43.677467 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 350/736] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:43 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:15:43.886545 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4fa64b6c-bfc1-4201-855e-10cda803d1e7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:43.887187 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4fa64b6c-bfc1-4201-855e-10cda803d1e7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:43.893371 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4fa64b6c-bfc1-4201-855e-10cda803d1e7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:43.893890 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4fa64b6c-bfc1-4201-855e-10cda803d1e7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:43.894324 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4fa64b6c-bfc1-4201-855e-10cda803d1e7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:43.895017 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4fa64b6c-bfc1-4201-855e-10cda803d1e7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:43.895464 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4fa64b6c-bfc1-4201-855e-10cda803d1e7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:43.895882 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4fa64b6c-bfc1-4201-855e-10cda803d1e7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:44.043629 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4fa64b6c-bfc1-4201-855e-10cda803d1e7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:44.052417 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4fa64b6c-bfc1-4201-855e-10cda803d1e7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1357 microversion: 2.1 time: 0.171576 Aug 30 01:15:44.052994 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 351/737] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:43 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:44.085010 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0b5e5f78-e1f6-4769-8d74-9e74df795b30 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.135324 Aug 30 01:15:44.090847 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 387/738] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:15:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:15:44.100556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a079323f-645d-4ffa-aeea-50a255033b19 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:44.102678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a079323f-645d-4ffa-aeea-50a255033b19 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:44.167407 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a079323f-645d-4ffa-aeea-50a255033b19 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:44.178577 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a079323f-645d-4ffa-aeea-50a255033b19 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1238 microversion: 2.1 time: 0.077658 Aug 30 01:15:44.178577 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 352/739] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:44 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1238 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:44.720179 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-7475ab17-be07-4d20-a57c-0fb1d1a806bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:44.720179 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-7475ab17-be07-4d20-a57c-0fb1d1a806bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:44.720179 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7475ab17-be07-4d20-a57c-0fb1d1a806bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:44.720179 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7475ab17-be07-4d20-a57c-0fb1d1a806bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:44.721649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7475ab17-be07-4d20-a57c-0fb1d1a806bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:44.721649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7475ab17-be07-4d20-a57c-0fb1d1a806bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:44.721649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7475ab17-be07-4d20-a57c-0fb1d1a806bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:44.721649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7475ab17-be07-4d20-a57c-0fb1d1a806bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:44.911756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7475ab17-be07-4d20-a57c-0fb1d1a806bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:44.922092 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7475ab17-be07-4d20-a57c-0fb1d1a806bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:44.924145 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7475ab17-be07-4d20-a57c-0fb1d1a806bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:44.925526 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-7475ab17-be07-4d20-a57c-0fb1d1a806bc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.237713 Aug 30 01:15:44.942867 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 388/740] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:44 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:45.074946 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-28f5bac0-1168-45f9-be20-3c475662d46e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:45.074946 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-28f5bac0-1168-45f9-be20-3c475662d46e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:45.082087 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-28f5bac0-1168-45f9-be20-3c475662d46e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:45.082579 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-28f5bac0-1168-45f9-be20-3c475662d46e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:45.083018 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-28f5bac0-1168-45f9-be20-3c475662d46e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:45.083730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-28f5bac0-1168-45f9-be20-3c475662d46e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:45.084187 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-28f5bac0-1168-45f9-be20-3c475662d46e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:45.084615 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-28f5bac0-1168-45f9-be20-3c475662d46e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:45.196616 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-8a067c86-8388-4c01-b278-033f7ce48c36 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:45.197703 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-8a067c86-8388-4c01-b278-033f7ce48c36 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:45.270571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-8a067c86-8388-4c01-b278-033f7ce48c36 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:45.277006 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-28f5bac0-1168-45f9-be20-3c475662d46e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:45.281253 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-8a067c86-8388-4c01-b278-033f7ce48c36 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1238 microversion: 2.1 time: 0.088400 Aug 30 01:15:45.286428 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-28f5bac0-1168-45f9-be20-3c475662d46e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1357 microversion: 2.1 time: 0.216877 Aug 30 01:15:45.296807 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 389/741] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:45 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1238 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:45.298484 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 353/742] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:45 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:45.951297 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-27e1aa37-0da5-4da3-bc48-16befc66236c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:45.952007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-27e1aa37-0da5-4da3-bc48-16befc66236c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:45.959264 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27e1aa37-0da5-4da3-bc48-16befc66236c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:45.959750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27e1aa37-0da5-4da3-bc48-16befc66236c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:45.960182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27e1aa37-0da5-4da3-bc48-16befc66236c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:45.960886 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27e1aa37-0da5-4da3-bc48-16befc66236c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:45.961358 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27e1aa37-0da5-4da3-bc48-16befc66236c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:45.962000 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27e1aa37-0da5-4da3-bc48-16befc66236c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:46.100659 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-27e1aa37-0da5-4da3-bc48-16befc66236c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:46.109774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-27e1aa37-0da5-4da3-bc48-16befc66236c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:46.111304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-27e1aa37-0da5-4da3-bc48-16befc66236c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:46.112416 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-27e1aa37-0da5-4da3-bc48-16befc66236c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.165673 Aug 30 01:15:46.113015 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 390/743] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:45 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:46.309289 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6c150100-9ed7-4e0e-89c9-33c29afeddb9 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:46.312628 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1a3b415d-532c-4056-ae76-958a3437e629 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:46.313306 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1a3b415d-532c-4056-ae76-958a3437e629 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:46.313970 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6c150100-9ed7-4e0e-89c9-33c29afeddb9 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:46.324663 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c150100-9ed7-4e0e-89c9-33c29afeddb9 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:46.325147 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c150100-9ed7-4e0e-89c9-33c29afeddb9 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:46.325283 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1a3b415d-532c-4056-ae76-958a3437e629 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:46.325569 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c150100-9ed7-4e0e-89c9-33c29afeddb9 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:46.325701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1a3b415d-532c-4056-ae76-958a3437e629 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:46.326143 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1a3b415d-532c-4056-ae76-958a3437e629 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:46.326291 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c150100-9ed7-4e0e-89c9-33c29afeddb9 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:46.326740 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c150100-9ed7-4e0e-89c9-33c29afeddb9 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:46.326842 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1a3b415d-532c-4056-ae76-958a3437e629 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:46.327162 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c150100-9ed7-4e0e-89c9-33c29afeddb9 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:46.327266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1a3b415d-532c-4056-ae76-958a3437e629 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:46.327696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1a3b415d-532c-4056-ae76-958a3437e629 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:46.415702 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1a3b415d-532c-4056-ae76-958a3437e629 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:46.424286 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1a3b415d-532c-4056-ae76-958a3437e629 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1242 microversion: 2.1 time: 0.123188 Aug 30 01:15:46.425466 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 354/744] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:46 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1242 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:46.501511 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6c150100-9ed7-4e0e-89c9-33c29afeddb9 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:46.511197 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6c150100-9ed7-4e0e-89c9-33c29afeddb9 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1357 microversion: 2.1 time: 0.206185 Aug 30 01:15:46.513760 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 391/745] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:46 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:47.136375 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bafe9816-fc7f-4d8d-a63d-49b691978831 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:47.136976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bafe9816-fc7f-4d8d-a63d-49b691978831 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:47.143044 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bafe9816-fc7f-4d8d-a63d-49b691978831 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:47.143521 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bafe9816-fc7f-4d8d-a63d-49b691978831 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:47.143950 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bafe9816-fc7f-4d8d-a63d-49b691978831 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:47.144624 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bafe9816-fc7f-4d8d-a63d-49b691978831 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:47.145067 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bafe9816-fc7f-4d8d-a63d-49b691978831 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:47.145615 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bafe9816-fc7f-4d8d-a63d-49b691978831 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:47.309979 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bafe9816-fc7f-4d8d-a63d-49b691978831 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:47.318201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bafe9816-fc7f-4d8d-a63d-49b691978831 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:47.319647 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bafe9816-fc7f-4d8d-a63d-49b691978831 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:47.321747 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bafe9816-fc7f-4d8d-a63d-49b691978831 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.189847 Aug 30 01:15:47.322423 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 355/746] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:47 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:47.447924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-8a39e191-9689-4b7a-b321-44baf567db1e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:47.448534 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-8a39e191-9689-4b7a-b321-44baf567db1e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:47.454979 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8a39e191-9689-4b7a-b321-44baf567db1e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:47.462945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8a39e191-9689-4b7a-b321-44baf567db1e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:47.462945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8a39e191-9689-4b7a-b321-44baf567db1e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:47.462945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8a39e191-9689-4b7a-b321-44baf567db1e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:47.462945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8a39e191-9689-4b7a-b321-44baf567db1e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:47.463352 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8a39e191-9689-4b7a-b321-44baf567db1e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:47.523516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-8a39e191-9689-4b7a-b321-44baf567db1e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:47.533064 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-8a39e191-9689-4b7a-b321-44baf567db1e tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1242 microversion: 2.1 time: 0.089808 Aug 30 01:15:47.537814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 392/747] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:47 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:47.537998 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2f943a8a-5e70-4960-9c91-80f233b87c51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:47.537998 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2f943a8a-5e70-4960-9c91-80f233b87c51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:47.542847 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f943a8a-5e70-4960-9c91-80f233b87c51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:47.548910 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f943a8a-5e70-4960-9c91-80f233b87c51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:47.548910 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f943a8a-5e70-4960-9c91-80f233b87c51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:47.548910 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f943a8a-5e70-4960-9c91-80f233b87c51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:47.548910 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f943a8a-5e70-4960-9c91-80f233b87c51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:47.549463 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f943a8a-5e70-4960-9c91-80f233b87c51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:47.988268 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2f943a8a-5e70-4960-9c91-80f233b87c51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:47.996840 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2f943a8a-5e70-4960-9c91-80f233b87c51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1357 microversion: 2.1 time: 0.465889 Aug 30 01:15:47.997428 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 356/748] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:47 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1357 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:48.346440 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e2cb2b85-9b78-4e00-9bcd-32c1f5207067 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:48.347045 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e2cb2b85-9b78-4e00-9bcd-32c1f5207067 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:48.353505 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e2cb2b85-9b78-4e00-9bcd-32c1f5207067 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:48.354028 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e2cb2b85-9b78-4e00-9bcd-32c1f5207067 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:48.354453 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e2cb2b85-9b78-4e00-9bcd-32c1f5207067 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:48.355148 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e2cb2b85-9b78-4e00-9bcd-32c1f5207067 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:48.355600 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e2cb2b85-9b78-4e00-9bcd-32c1f5207067 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:48.356020 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e2cb2b85-9b78-4e00-9bcd-32c1f5207067 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:48.488452 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e2cb2b85-9b78-4e00-9bcd-32c1f5207067 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:48.497229 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e2cb2b85-9b78-4e00-9bcd-32c1f5207067 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:48.500534 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e2cb2b85-9b78-4e00-9bcd-32c1f5207067 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:48.500534 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e2cb2b85-9b78-4e00-9bcd-32c1f5207067 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.157215 Aug 30 01:15:48.500534 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 393/749] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:48 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:48.553654 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bbdb8762-c51a-4c18-82ae-50ca8ff00c8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:48.554448 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bbdb8762-c51a-4c18-82ae-50ca8ff00c8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:48.561608 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbdb8762-c51a-4c18-82ae-50ca8ff00c8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:48.562128 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbdb8762-c51a-4c18-82ae-50ca8ff00c8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:48.562651 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbdb8762-c51a-4c18-82ae-50ca8ff00c8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:48.563398 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbdb8762-c51a-4c18-82ae-50ca8ff00c8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:48.563956 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbdb8762-c51a-4c18-82ae-50ca8ff00c8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:48.564823 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbdb8762-c51a-4c18-82ae-50ca8ff00c8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:48.630983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bbdb8762-c51a-4c18-82ae-50ca8ff00c8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:48.636456 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bbdb8762-c51a-4c18-82ae-50ca8ff00c8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1290 microversion: 2.1 time: 0.086869 Aug 30 01:15:48.637020 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 357/750] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:48 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:49.017702 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a7fe84ac-39c4-42c9-a1d4-41453d01dc23 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:49.018652 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a7fe84ac-39c4-42c9-a1d4-41453d01dc23 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:49.025247 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a7fe84ac-39c4-42c9-a1d4-41453d01dc23 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:49.030881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a7fe84ac-39c4-42c9-a1d4-41453d01dc23 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:49.030881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a7fe84ac-39c4-42c9-a1d4-41453d01dc23 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:49.030881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a7fe84ac-39c4-42c9-a1d4-41453d01dc23 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:49.030881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a7fe84ac-39c4-42c9-a1d4-41453d01dc23 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:49.031272 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a7fe84ac-39c4-42c9-a1d4-41453d01dc23 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:49.166030 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a7fe84ac-39c4-42c9-a1d4-41453d01dc23 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:49.174373 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a7fe84ac-39c4-42c9-a1d4-41453d01dc23 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1357 microversion: 2.1 time: 0.160520 Aug 30 01:15:49.174973 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 394/751] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:49 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:49.522598 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b12c2417-eb38-4329-b236-d3f8d1f74a80 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:49.523204 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b12c2417-eb38-4329-b236-d3f8d1f74a80 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:49.529592 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b12c2417-eb38-4329-b236-d3f8d1f74a80 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:49.530123 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b12c2417-eb38-4329-b236-d3f8d1f74a80 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:49.530579 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b12c2417-eb38-4329-b236-d3f8d1f74a80 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:49.531430 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b12c2417-eb38-4329-b236-d3f8d1f74a80 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:49.531893 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b12c2417-eb38-4329-b236-d3f8d1f74a80 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:49.532319 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b12c2417-eb38-4329-b236-d3f8d1f74a80 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:49.657389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-75af2529-a009-4bd5-a93c-ffbe741d04ea tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:49.658061 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-75af2529-a009-4bd5-a93c-ffbe741d04ea tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:49.665640 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75af2529-a009-4bd5-a93c-ffbe741d04ea tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:49.666250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75af2529-a009-4bd5-a93c-ffbe741d04ea tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:49.666759 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75af2529-a009-4bd5-a93c-ffbe741d04ea tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:49.667822 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75af2529-a009-4bd5-a93c-ffbe741d04ea tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:49.668505 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75af2529-a009-4bd5-a93c-ffbe741d04ea tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:49.668851 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-75af2529-a009-4bd5-a93c-ffbe741d04ea tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:49.692648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=100 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:49.743959 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-75af2529-a009-4bd5-a93c-ffbe741d04ea tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:49.752824 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-75af2529-a009-4bd5-a93c-ffbe741d04ea tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1296 microversion: 2.1 time: 0.099469 Aug 30 01:15:49.753463 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 395/752] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:49 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:15:49.810995 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b12c2417-eb38-4329-b236-d3f8d1f74a80 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:49.819226 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b12c2417-eb38-4329-b236-d3f8d1f74a80 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:49.820692 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b12c2417-eb38-4329-b236-d3f8d1f74a80 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:49.821829 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b12c2417-eb38-4329-b236-d3f8d1f74a80 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.303141 Aug 30 01:15:49.822400 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 358/753] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:49 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:50.195863 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2b632343-ff61-4984-8367-6cf8e37b4e35 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:50.196779 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2b632343-ff61-4984-8367-6cf8e37b4e35 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:50.203243 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2b632343-ff61-4984-8367-6cf8e37b4e35 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:50.203733 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2b632343-ff61-4984-8367-6cf8e37b4e35 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:50.204334 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2b632343-ff61-4984-8367-6cf8e37b4e35 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:50.205041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2b632343-ff61-4984-8367-6cf8e37b4e35 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:50.205492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2b632343-ff61-4984-8367-6cf8e37b4e35 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:50.205944 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2b632343-ff61-4984-8367-6cf8e37b4e35 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:50.347488 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2b632343-ff61-4984-8367-6cf8e37b4e35 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:50.358696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2b632343-ff61-4984-8367-6cf8e37b4e35 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1357 microversion: 2.1 time: 0.167104 Aug 30 01:15:50.360063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 396/754] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:50 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:50.774375 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9ce2f50b-fd64-4d36-b47e-3620e45f4602 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:50.775256 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9ce2f50b-fd64-4d36-b47e-3620e45f4602 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:50.781347 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ce2f50b-fd64-4d36-b47e-3620e45f4602 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:50.781911 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ce2f50b-fd64-4d36-b47e-3620e45f4602 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:50.782309 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ce2f50b-fd64-4d36-b47e-3620e45f4602 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:50.782994 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ce2f50b-fd64-4d36-b47e-3620e45f4602 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:50.783449 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ce2f50b-fd64-4d36-b47e-3620e45f4602 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:50.783872 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ce2f50b-fd64-4d36-b47e-3620e45f4602 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:50.844558 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-45cfe136-9504-4917-b9db-e8cc0e51ea00 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:50.845228 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-45cfe136-9504-4917-b9db-e8cc0e51ea00 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:50.852441 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-45cfe136-9504-4917-b9db-e8cc0e51ea00 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:50.852932 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-45cfe136-9504-4917-b9db-e8cc0e51ea00 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:50.853373 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-45cfe136-9504-4917-b9db-e8cc0e51ea00 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:50.854114 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-45cfe136-9504-4917-b9db-e8cc0e51ea00 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:50.854578 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-45cfe136-9504-4917-b9db-e8cc0e51ea00 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:50.855006 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-45cfe136-9504-4917-b9db-e8cc0e51ea00 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:50.920062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9ce2f50b-fd64-4d36-b47e-3620e45f4602 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:50.927806 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9ce2f50b-fd64-4d36-b47e-3620e45f4602 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1363 microversion: 2.1 time: 0.157280 Aug 30 01:15:50.928369 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 359/755] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:50 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:50.984295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-45cfe136-9504-4917-b9db-e8cc0e51ea00 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:50.992861 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-45cfe136-9504-4917-b9db-e8cc0e51ea00 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:50.994354 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-45cfe136-9504-4917-b9db-e8cc0e51ea00 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:50.995452 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-45cfe136-9504-4917-b9db-e8cc0e51ea00 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.154866 Aug 30 01:15:50.996019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 397/756] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:50 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:15:51.380615 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fe39244b-f302-4410-a09b-154eb1736981 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:51.381227 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fe39244b-f302-4410-a09b-154eb1736981 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:51.387365 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe39244b-f302-4410-a09b-154eb1736981 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:51.394292 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe39244b-f302-4410-a09b-154eb1736981 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:51.394292 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe39244b-f302-4410-a09b-154eb1736981 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:51.394292 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe39244b-f302-4410-a09b-154eb1736981 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:51.394292 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe39244b-f302-4410-a09b-154eb1736981 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:51.394780 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe39244b-f302-4410-a09b-154eb1736981 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:51.520736 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fe39244b-f302-4410-a09b-154eb1736981 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:51.529310 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fe39244b-f302-4410-a09b-154eb1736981 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1357 microversion: 2.1 time: 0.152492 Aug 30 01:15:51.529913 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 360/757] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:51 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:52.004022 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f7a870a5-452e-400f-a686-ff0832df5f8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:52.004645 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f7a870a5-452e-400f-a686-ff0832df5f8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:52.011409 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7a870a5-452e-400f-a686-ff0832df5f8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:52.011902 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7a870a5-452e-400f-a686-ff0832df5f8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:52.012339 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7a870a5-452e-400f-a686-ff0832df5f8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:52.013041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7a870a5-452e-400f-a686-ff0832df5f8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:52.013534 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7a870a5-452e-400f-a686-ff0832df5f8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:52.013999 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7a870a5-452e-400f-a686-ff0832df5f8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:52.024498 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-82df3a14-dd95-4069-b418-7ccd7c671305 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:52.025266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-82df3a14-dd95-4069-b418-7ccd7c671305 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:52.031921 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82df3a14-dd95-4069-b418-7ccd7c671305 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:52.032503 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82df3a14-dd95-4069-b418-7ccd7c671305 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:52.033268 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82df3a14-dd95-4069-b418-7ccd7c671305 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:52.033809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82df3a14-dd95-4069-b418-7ccd7c671305 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:52.034337 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82df3a14-dd95-4069-b418-7ccd7c671305 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:52.034773 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82df3a14-dd95-4069-b418-7ccd7c671305 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:52.348063 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-82df3a14-dd95-4069-b418-7ccd7c671305 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:52.357956 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-82df3a14-dd95-4069-b418-7ccd7c671305 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:52.359898 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-82df3a14-dd95-4069-b418-7ccd7c671305 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:52.369272 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-82df3a14-dd95-4069-b418-7ccd7c671305 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.341179 Aug 30 01:15:52.369272 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 361/758] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:52 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:15:52.384423 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f7a870a5-452e-400f-a686-ff0832df5f8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:52.392323 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f7a870a5-452e-400f-a686-ff0832df5f8d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1363 microversion: 2.1 time: 0.447800 Aug 30 01:15:52.393127 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 398/759] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:51 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1363 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:52.559179 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1932ef00-93db-4d74-b5ea-6b647d10197f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:52.559792 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1932ef00-93db-4d74-b5ea-6b647d10197f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:52.565720 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1932ef00-93db-4d74-b5ea-6b647d10197f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:52.566243 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1932ef00-93db-4d74-b5ea-6b647d10197f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:52.568719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1932ef00-93db-4d74-b5ea-6b647d10197f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:52.568719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1932ef00-93db-4d74-b5ea-6b647d10197f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:52.568719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1932ef00-93db-4d74-b5ea-6b647d10197f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:52.568719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1932ef00-93db-4d74-b5ea-6b647d10197f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:52.764840 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1932ef00-93db-4d74-b5ea-6b647d10197f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:52.773466 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1932ef00-93db-4d74-b5ea-6b647d10197f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1357 microversion: 2.1 time: 0.218905 Aug 30 01:15:52.774631 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 362/760] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:52 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:52.940478 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-e0eb7b44-d807-4c64-ad30-0b3eda1194e7 req-ee96d96f-b95d-4983-8056-ad3d67c7aa70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ae3ba30-d38c-4e44-bc40-c9bda178d1b5", "tag": "d73390a3-6a1a-4a0a-9fab-afc8d7d090e9"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:52.956940 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-e0eb7b44-d807-4c64-ad30-0b3eda1194e7 req-ee96d96f-b95d-4983-8056-ad3d67c7aa70 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:52.959501 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-e0eb7b44-d807-4c64-ad30-0b3eda1194e7 req-ee96d96f-b95d-4983-8056-ad3d67c7aa70 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:52.959501 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-e0eb7b44-d807-4c64-ad30-0b3eda1194e7 req-ee96d96f-b95d-4983-8056-ad3d67c7aa70 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:52.975447 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-e0eb7b44-d807-4c64-ad30-0b3eda1194e7 req-ee96d96f-b95d-4983-8056-ad3d67c7aa70 service nova] Creating event network-changed:d73390a3-6a1a-4a0a-9fab-afc8d7d090e9 for instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 on hv-cinder-81571 Aug 30 01:15:52.981460 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-e0eb7b44-d807-4c64-ad30-0b3eda1194e7 req-ee96d96f-b95d-4983-8056-ad3d67c7aa70 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046545 Aug 30 01:15:52.982479 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 399/761] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:53.384118 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d3b8857d-b265-4c31-b2b9-e386f171dd5e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:53.384741 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d3b8857d-b265-4c31-b2b9-e386f171dd5e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:53.391474 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3b8857d-b265-4c31-b2b9-e386f171dd5e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:53.405882 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3b8857d-b265-4c31-b2b9-e386f171dd5e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:53.405882 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3b8857d-b265-4c31-b2b9-e386f171dd5e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:53.405882 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3b8857d-b265-4c31-b2b9-e386f171dd5e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:53.405882 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3b8857d-b265-4c31-b2b9-e386f171dd5e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:53.406437 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3b8857d-b265-4c31-b2b9-e386f171dd5e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:53.413711 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9e848ff7-d6f9-4094-8c8e-7b69fddfb55d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:53.415211 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9e848ff7-d6f9-4094-8c8e-7b69fddfb55d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:53.422187 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9e848ff7-d6f9-4094-8c8e-7b69fddfb55d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:53.423008 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9e848ff7-d6f9-4094-8c8e-7b69fddfb55d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:53.423508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9e848ff7-d6f9-4094-8c8e-7b69fddfb55d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:53.424290 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9e848ff7-d6f9-4094-8c8e-7b69fddfb55d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:53.424950 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9e848ff7-d6f9-4094-8c8e-7b69fddfb55d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:53.425482 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9e848ff7-d6f9-4094-8c8e-7b69fddfb55d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:53.551937 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=2 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:53.567099 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9e848ff7-d6f9-4094-8c8e-7b69fddfb55d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:53.571542 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9e848ff7-d6f9-4094-8c8e-7b69fddfb55d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1363 microversion: 2.1 time: 0.161612 Aug 30 01:15:53.572125 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 400/762] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:53 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:53.613711 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d3b8857d-b265-4c31-b2b9-e386f171dd5e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:53.622832 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d3b8857d-b265-4c31-b2b9-e386f171dd5e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:53.624366 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d3b8857d-b265-4c31-b2b9-e386f171dd5e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:53.625501 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d3b8857d-b265-4c31-b2b9-e386f171dd5e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.245559 Aug 30 01:15:53.626310 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 363/763] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:53 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:53.795704 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-982cfa6e-c5b7-4ca9-90e8-5555a16e38d4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:53.797048 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-982cfa6e-c5b7-4ca9-90e8-5555a16e38d4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:53.803691 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-982cfa6e-c5b7-4ca9-90e8-5555a16e38d4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:53.804176 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-982cfa6e-c5b7-4ca9-90e8-5555a16e38d4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:53.804610 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-982cfa6e-c5b7-4ca9-90e8-5555a16e38d4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:53.805880 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-982cfa6e-c5b7-4ca9-90e8-5555a16e38d4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:53.806338 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-982cfa6e-c5b7-4ca9-90e8-5555a16e38d4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:53.806761 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-982cfa6e-c5b7-4ca9-90e8-5555a16e38d4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:53.945559 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-982cfa6e-c5b7-4ca9-90e8-5555a16e38d4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:53.954098 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-982cfa6e-c5b7-4ca9-90e8-5555a16e38d4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1357 microversion: 2.1 time: 0.162471 Aug 30 01:15:53.954670 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 401/764] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:53 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:54.452191 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-b0f81f2c-edb5-436f-b495-34e3ad9ff640 req-060af1ae-0931-4011-86ba-6c9f02137771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb98683-87f8-47ff-89d6-4d74e9f961d1", "name": "network-vif-plugged", "status": "completed", "tag": "fb9f85b8-7682-4117-938b-7225f55cd3b2"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:54.457609 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=14 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:54.463994 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-b0f81f2c-edb5-436f-b495-34e3ad9ff640 req-060af1ae-0931-4011-86ba-6c9f02137771 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:54.464478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-b0f81f2c-edb5-436f-b495-34e3ad9ff640 req-060af1ae-0931-4011-86ba-6c9f02137771 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:54.464902 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-b0f81f2c-edb5-436f-b495-34e3ad9ff640 req-060af1ae-0931-4011-86ba-6c9f02137771 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:54.476686 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-b0f81f2c-edb5-436f-b495-34e3ad9ff640 req-060af1ae-0931-4011-86ba-6c9f02137771 service nova] Creating event network-vif-plugged:fb9f85b8-7682-4117-938b-7225f55cd3b2 for instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 on hv-cinder-81571 Aug 30 01:15:54.482888 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-b0f81f2c-edb5-436f-b495-34e3ad9ff640 req-060af1ae-0931-4011-86ba-6c9f02137771 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034456 Aug 30 01:15:54.490268 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 364/765] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:54.592952 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-718cf9b7-791a-45fb-a9fd-5518c855bed9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:54.593716 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-718cf9b7-791a-45fb-a9fd-5518c855bed9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:54.599741 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-718cf9b7-791a-45fb-a9fd-5518c855bed9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:54.600232 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-718cf9b7-791a-45fb-a9fd-5518c855bed9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:54.600676 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-718cf9b7-791a-45fb-a9fd-5518c855bed9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:54.601381 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-718cf9b7-791a-45fb-a9fd-5518c855bed9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:54.601869 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-718cf9b7-791a-45fb-a9fd-5518c855bed9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:54.602946 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-718cf9b7-791a-45fb-a9fd-5518c855bed9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:54.650929 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1350a000-d165-4f59-a04d-8341e0ffbae3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:54.651638 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1350a000-d165-4f59-a04d-8341e0ffbae3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:54.658453 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1350a000-d165-4f59-a04d-8341e0ffbae3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:54.658942 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1350a000-d165-4f59-a04d-8341e0ffbae3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:54.659363 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1350a000-d165-4f59-a04d-8341e0ffbae3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:54.660071 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1350a000-d165-4f59-a04d-8341e0ffbae3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:54.660526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1350a000-d165-4f59-a04d-8341e0ffbae3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:54.660956 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1350a000-d165-4f59-a04d-8341e0ffbae3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:54.736473 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-718cf9b7-791a-45fb-a9fd-5518c855bed9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:54.744979 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-718cf9b7-791a-45fb-a9fd-5518c855bed9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1363 microversion: 2.1 time: 0.155976 Aug 30 01:15:54.745564 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 402/766] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:54 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:54.795535 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1350a000-d165-4f59-a04d-8341e0ffbae3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:54.803845 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1350a000-d165-4f59-a04d-8341e0ffbae3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:54.805297 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1350a000-d165-4f59-a04d-8341e0ffbae3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:54.806442 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1350a000-d165-4f59-a04d-8341e0ffbae3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.160796 Aug 30 01:15:54.807007 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 365/767] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:54 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:15:54.975754 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-54b8eec2-e8d8-447d-bb01-9343c20e94d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:54.976267 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-54b8eec2-e8d8-447d-bb01-9343c20e94d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:54.983162 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54b8eec2-e8d8-447d-bb01-9343c20e94d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:54.983644 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54b8eec2-e8d8-447d-bb01-9343c20e94d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:54.984079 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54b8eec2-e8d8-447d-bb01-9343c20e94d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:54.984770 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54b8eec2-e8d8-447d-bb01-9343c20e94d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:54.985231 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54b8eec2-e8d8-447d-bb01-9343c20e94d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:54.985652 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54b8eec2-e8d8-447d-bb01-9343c20e94d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:55.117544 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-54b8eec2-e8d8-447d-bb01-9343c20e94d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:55.125484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-54b8eec2-e8d8-447d-bb01-9343c20e94d1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1357 microversion: 2.1 time: 0.153672 Aug 30 01:15:55.126087 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 403/768] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:54 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:55.766356 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b3da2a4f-1d95-4008-8a5a-e9ab50047409 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:55.766805 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b3da2a4f-1d95-4008-8a5a-e9ab50047409 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:55.772958 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3da2a4f-1d95-4008-8a5a-e9ab50047409 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:55.773447 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3da2a4f-1d95-4008-8a5a-e9ab50047409 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:55.774510 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3da2a4f-1d95-4008-8a5a-e9ab50047409 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:55.775225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3da2a4f-1d95-4008-8a5a-e9ab50047409 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:55.775687 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3da2a4f-1d95-4008-8a5a-e9ab50047409 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:55.776120 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3da2a4f-1d95-4008-8a5a-e9ab50047409 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:55.832738 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-df8a043a-f7c0-48fb-a0e6-480242b8ebe4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:55.834037 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-df8a043a-f7c0-48fb-a0e6-480242b8ebe4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:55.837260 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=8 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:55.845860 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-df8a043a-f7c0-48fb-a0e6-480242b8ebe4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:55.849779 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-df8a043a-f7c0-48fb-a0e6-480242b8ebe4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:55.849779 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-df8a043a-f7c0-48fb-a0e6-480242b8ebe4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:55.849779 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-df8a043a-f7c0-48fb-a0e6-480242b8ebe4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:55.849779 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-df8a043a-f7c0-48fb-a0e6-480242b8ebe4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:55.850344 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-df8a043a-f7c0-48fb-a0e6-480242b8ebe4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:55.927013 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b3da2a4f-1d95-4008-8a5a-e9ab50047409 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:55.935810 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b3da2a4f-1d95-4008-8a5a-e9ab50047409 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1363 microversion: 2.1 time: 0.173697 Aug 30 01:15:55.936317 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 366/769] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:55 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:55.986403 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-df8a043a-f7c0-48fb-a0e6-480242b8ebe4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:55.995309 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-df8a043a-f7c0-48fb-a0e6-480242b8ebe4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:55.996798 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-df8a043a-f7c0-48fb-a0e6-480242b8ebe4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:55.997924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-df8a043a-f7c0-48fb-a0e6-480242b8ebe4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.172763 Aug 30 01:15:55.998547 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 404/770] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:55 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:15:56.146709 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c9821203-4830-4f9e-9974-69b47186f37d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:56.147330 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c9821203-4830-4f9e-9974-69b47186f37d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:56.153442 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c9821203-4830-4f9e-9974-69b47186f37d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:56.153958 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c9821203-4830-4f9e-9974-69b47186f37d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:56.154405 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c9821203-4830-4f9e-9974-69b47186f37d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:56.155109 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c9821203-4830-4f9e-9974-69b47186f37d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:56.155571 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c9821203-4830-4f9e-9974-69b47186f37d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:56.155997 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c9821203-4830-4f9e-9974-69b47186f37d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:56.286294 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c9821203-4830-4f9e-9974-69b47186f37d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:56.294630 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c9821203-4830-4f9e-9974-69b47186f37d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1357 microversion: 2.1 time: 0.151683 Aug 30 01:15:56.295232 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 367/771] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:56 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:56.498860 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-a1eefaa2-1578-42f8-9f69-39de84bc9966 req-22c6825e-f5a4-4b23-81ee-b60c6f865a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b743eb-1b3f-458d-ad48-d60c3934ba0d", "name": "network-vif-plugged", "status": "completed", "tag": "adb8f445-f2e5-41a5-91ba-43406b91be88"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:15:56.508924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-a1eefaa2-1578-42f8-9f69-39de84bc9966 req-22c6825e-f5a4-4b23-81ee-b60c6f865a42 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:56.513022 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-a1eefaa2-1578-42f8-9f69-39de84bc9966 req-22c6825e-f5a4-4b23-81ee-b60c6f865a42 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:56.513022 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-a1eefaa2-1578-42f8-9f69-39de84bc9966 req-22c6825e-f5a4-4b23-81ee-b60c6f865a42 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:56.522858 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-a1eefaa2-1578-42f8-9f69-39de84bc9966 req-22c6825e-f5a4-4b23-81ee-b60c6f865a42 service nova] Creating event network-vif-plugged:adb8f445-f2e5-41a5-91ba-43406b91be88 for instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d on hv-cinder-81571 Aug 30 01:15:56.528473 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-a1eefaa2-1578-42f8-9f69-39de84bc9966 req-22c6825e-f5a4-4b23-81ee-b60c6f865a42 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033223 Aug 30 01:15:56.529067 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 405/772] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:15:56.956255 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d13a8f7d-6f0f-4b6c-8e43-3d875ce4ca2d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:56.956858 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d13a8f7d-6f0f-4b6c-8e43-3d875ce4ca2d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:56.964010 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d13a8f7d-6f0f-4b6c-8e43-3d875ce4ca2d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:56.964492 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d13a8f7d-6f0f-4b6c-8e43-3d875ce4ca2d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:56.964961 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d13a8f7d-6f0f-4b6c-8e43-3d875ce4ca2d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:56.965648 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d13a8f7d-6f0f-4b6c-8e43-3d875ce4ca2d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:56.966205 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d13a8f7d-6f0f-4b6c-8e43-3d875ce4ca2d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:56.966628 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d13a8f7d-6f0f-4b6c-8e43-3d875ce4ca2d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:56.982142 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:15:57.021359 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b919c8ee-9f95-4ce1-832e-21afb118746a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:57.022082 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b919c8ee-9f95-4ce1-832e-21afb118746a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:57.028698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b919c8ee-9f95-4ce1-832e-21afb118746a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:57.029239 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b919c8ee-9f95-4ce1-832e-21afb118746a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:57.029675 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b919c8ee-9f95-4ce1-832e-21afb118746a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:57.030394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b919c8ee-9f95-4ce1-832e-21afb118746a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:57.030842 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b919c8ee-9f95-4ce1-832e-21afb118746a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:57.031262 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b919c8ee-9f95-4ce1-832e-21afb118746a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:57.100459 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d13a8f7d-6f0f-4b6c-8e43-3d875ce4ca2d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:57.108397 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d13a8f7d-6f0f-4b6c-8e43-3d875ce4ca2d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1363 microversion: 2.1 time: 0.156014 Aug 30 01:15:57.108981 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 368/773] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:56 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:57.167428 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-b919c8ee-9f95-4ce1-832e-21afb118746a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:57.175638 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-b919c8ee-9f95-4ce1-832e-21afb118746a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:57.177087 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-b919c8ee-9f95-4ce1-832e-21afb118746a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:57.178243 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-b919c8ee-9f95-4ce1-832e-21afb118746a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.161596 Aug 30 01:15:57.178810 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 406/774] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:57 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:15:57.316111 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dcba0cb0-516b-418e-a2cc-144e7d5a3f51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:57.316721 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dcba0cb0-516b-418e-a2cc-144e7d5a3f51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:57.322966 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dcba0cb0-516b-418e-a2cc-144e7d5a3f51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:57.323446 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dcba0cb0-516b-418e-a2cc-144e7d5a3f51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:57.324024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dcba0cb0-516b-418e-a2cc-144e7d5a3f51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:57.324631 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dcba0cb0-516b-418e-a2cc-144e7d5a3f51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:57.325078 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dcba0cb0-516b-418e-a2cc-144e7d5a3f51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:57.325497 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dcba0cb0-516b-418e-a2cc-144e7d5a3f51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:57.455817 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dcba0cb0-516b-418e-a2cc-144e7d5a3f51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:57.464198 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dcba0cb0-516b-418e-a2cc-144e7d5a3f51 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1357 microversion: 2.1 time: 0.151964 Aug 30 01:15:57.464803 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 369/775] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:57 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:58.130538 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-464dd2bd-f7a2-4b26-b472-5616188c8a45 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:58.131616 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-464dd2bd-f7a2-4b26-b472-5616188c8a45 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:58.140154 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-464dd2bd-f7a2-4b26-b472-5616188c8a45 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:58.140646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-464dd2bd-f7a2-4b26-b472-5616188c8a45 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:58.141452 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-464dd2bd-f7a2-4b26-b472-5616188c8a45 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:58.142762 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-464dd2bd-f7a2-4b26-b472-5616188c8a45 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:58.143383 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-464dd2bd-f7a2-4b26-b472-5616188c8a45 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:58.144149 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-464dd2bd-f7a2-4b26-b472-5616188c8a45 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:58.201928 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5879729c-4949-4857-83a6-5a492d0fb5a1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:58.202781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5879729c-4949-4857-83a6-5a492d0fb5a1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:58.209657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5879729c-4949-4857-83a6-5a492d0fb5a1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:58.210186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5879729c-4949-4857-83a6-5a492d0fb5a1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:58.210653 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5879729c-4949-4857-83a6-5a492d0fb5a1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:58.211990 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5879729c-4949-4857-83a6-5a492d0fb5a1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:58.212580 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5879729c-4949-4857-83a6-5a492d0fb5a1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:58.213034 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5879729c-4949-4857-83a6-5a492d0fb5a1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:58.297428 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-464dd2bd-f7a2-4b26-b472-5616188c8a45 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:58.307215 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-464dd2bd-f7a2-4b26-b472-5616188c8a45 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1363 microversion: 2.1 time: 0.182092 Aug 30 01:15:58.307918 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 407/776] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:58 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:58.355917 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5879729c-4949-4857-83a6-5a492d0fb5a1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:58.364145 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5879729c-4949-4857-83a6-5a492d0fb5a1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:58.365493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5879729c-4949-4857-83a6-5a492d0fb5a1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:58.366617 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5879729c-4949-4857-83a6-5a492d0fb5a1 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.168694 Aug 30 01:15:58.367175 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 370/777] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:58 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:15:58.491565 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-87517a12-e52d-4daf-ba40-b535e0485948 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:58.492172 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-87517a12-e52d-4daf-ba40-b535e0485948 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:58.498745 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87517a12-e52d-4daf-ba40-b535e0485948 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:58.502064 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87517a12-e52d-4daf-ba40-b535e0485948 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:58.502064 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87517a12-e52d-4daf-ba40-b535e0485948 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:58.502064 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87517a12-e52d-4daf-ba40-b535e0485948 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:58.502064 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87517a12-e52d-4daf-ba40-b535e0485948 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:58.502480 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87517a12-e52d-4daf-ba40-b535e0485948 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:58.632519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-87517a12-e52d-4daf-ba40-b535e0485948 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:58.640785 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-87517a12-e52d-4daf-ba40-b535e0485948 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1546 microversion: 2.1 time: 0.153325 Aug 30 01:15:58.641371 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 408/778] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:58 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:58.661845 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5fd27fe8-3917-4705-9f8c-55e3387d8421 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:58.662458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5fd27fe8-3917-4705-9f8c-55e3387d8421 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:58.669199 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fd27fe8-3917-4705-9f8c-55e3387d8421 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:58.669684 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fd27fe8-3917-4705-9f8c-55e3387d8421 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:58.670147 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fd27fe8-3917-4705-9f8c-55e3387d8421 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:58.670839 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fd27fe8-3917-4705-9f8c-55e3387d8421 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:58.671292 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fd27fe8-3917-4705-9f8c-55e3387d8421 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:58.671714 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fd27fe8-3917-4705-9f8c-55e3387d8421 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:58.803540 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5fd27fe8-3917-4705-9f8c-55e3387d8421 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:58.813610 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5fd27fe8-3917-4705-9f8c-55e3387d8421 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1546 microversion: 2.1 time: 0.156640 Aug 30 01:15:58.814288 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 371/779] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:58 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:58.833722 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-edb31a7c-b7a9-4d6e-9828-9e3d82668f3d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:58.839022 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-edb31a7c-b7a9-4d6e-9828-9e3d82668f3d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:58.839808 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-edb31a7c-b7a9-4d6e-9828-9e3d82668f3d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Searching by: {'deleted': False, 'project_id': 'c6f3997439524d4583ece79273a55da4'} {{(pid=121233) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 01:15:58.846537 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-edb31a7c-b7a9-4d6e-9828-9e3d82668f3d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:58.847020 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-edb31a7c-b7a9-4d6e-9828-9e3d82668f3d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:58.847453 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-edb31a7c-b7a9-4d6e-9828-9e3d82668f3d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:58.848175 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-edb31a7c-b7a9-4d6e-9828-9e3d82668f3d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:58.848686 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-edb31a7c-b7a9-4d6e-9828-9e3d82668f3d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:58.849112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-edb31a7c-b7a9-4d6e-9828-9e3d82668f3d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:58.945342 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.multi_cell_list [None req-edb31a7c-b7a9-4d6e-9828-9e3d82668f3d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121233) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 01:15:59.198515 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-edb31a7c-b7a9-4d6e-9828-9e3d82668f3d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.368393 Aug 30 01:15:59.199173 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 409/780] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Aug 30 01:15:58 2022] GET /compute/v2.1/servers => generated 342 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:15:59.210344 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-988ce86f-af2a-48ee-998b-89cf52a44672 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:59.210979 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-988ce86f-af2a-48ee-998b-89cf52a44672 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:59.217354 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-988ce86f-af2a-48ee-998b-89cf52a44672 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:59.217878 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-988ce86f-af2a-48ee-998b-89cf52a44672 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:59.218314 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-988ce86f-af2a-48ee-998b-89cf52a44672 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:59.219081 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-988ce86f-af2a-48ee-998b-89cf52a44672 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:59.219539 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-988ce86f-af2a-48ee-998b-89cf52a44672 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:59.219963 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-988ce86f-af2a-48ee-998b-89cf52a44672 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:59.328950 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-8c3d11ca-adf0-4702-8762-06589df503ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:59.329435 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-8c3d11ca-adf0-4702-8762-06589df503ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:59.336663 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8c3d11ca-adf0-4702-8762-06589df503ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:59.337203 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8c3d11ca-adf0-4702-8762-06589df503ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:59.337644 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8c3d11ca-adf0-4702-8762-06589df503ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:59.338437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8c3d11ca-adf0-4702-8762-06589df503ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:59.338956 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8c3d11ca-adf0-4702-8762-06589df503ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:59.339324 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8c3d11ca-adf0-4702-8762-06589df503ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:59.354434 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-988ce86f-af2a-48ee-998b-89cf52a44672 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:59.361986 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-988ce86f-af2a-48ee-998b-89cf52a44672 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1546 microversion: 2.1 time: 0.155580 Aug 30 01:15:59.362826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 372/781] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:59 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:59.456639 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4c26466f-852c-4b38-9d35-301a3b1e1dca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:15:59.456639 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4c26466f-852c-4b38-9d35-301a3b1e1dca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:15:59.460099 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c26466f-852c-4b38-9d35-301a3b1e1dca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:59.460598 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c26466f-852c-4b38-9d35-301a3b1e1dca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:59.461108 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c26466f-852c-4b38-9d35-301a3b1e1dca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:59.462870 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c26466f-852c-4b38-9d35-301a3b1e1dca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:15:59.463138 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c26466f-852c-4b38-9d35-301a3b1e1dca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:15:59.463561 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c26466f-852c-4b38-9d35-301a3b1e1dca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:15:59.488845 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-8c3d11ca-adf0-4702-8762-06589df503ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:59.499727 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-8c3d11ca-adf0-4702-8762-06589df503ff tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1363 microversion: 2.1 time: 0.174680 Aug 30 01:15:59.500909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 410/782] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:15:59 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:15:59.607030 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4c26466f-852c-4b38-9d35-301a3b1e1dca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:59.615324 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4c26466f-852c-4b38-9d35-301a3b1e1dca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:59.616773 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4c26466f-852c-4b38-9d35-301a3b1e1dca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:15:59.618297 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4c26466f-852c-4b38-9d35-301a3b1e1dca tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1406 microversion: 2.20 time: 0.233028 Aug 30 01:15:59.618740 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 373/783] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:15:59 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:16:00.400153 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-9f80d324-dacb-4f0f-bb03-36f92b93ef0a req-4c276df5-94c9-4aad-81f9-987707a07b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae3ba30-d38c-4e44-bc40-c9bda178d1b5", "name": "network-vif-plugged", "status": "completed", "tag": "d73390a3-6a1a-4a0a-9fab-afc8d7d090e9"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:00.411093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-9f80d324-dacb-4f0f-bb03-36f92b93ef0a req-4c276df5-94c9-4aad-81f9-987707a07b7d service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:00.411565 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-9f80d324-dacb-4f0f-bb03-36f92b93ef0a req-4c276df5-94c9-4aad-81f9-987707a07b7d service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:00.411984 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-9f80d324-dacb-4f0f-bb03-36f92b93ef0a req-4c276df5-94c9-4aad-81f9-987707a07b7d service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:00.424197 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-9f80d324-dacb-4f0f-bb03-36f92b93ef0a req-4c276df5-94c9-4aad-81f9-987707a07b7d service nova] Creating event network-vif-plugged:d73390a3-6a1a-4a0a-9fab-afc8d7d090e9 for instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 on hv-cinder-81571 Aug 30 01:16:00.429438 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-9f80d324-dacb-4f0f-bb03-36f92b93ef0a req-4c276df5-94c9-4aad-81f9-987707a07b7d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033452 Aug 30 01:16:00.430762 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 411/784] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:00.521974 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b7c3cac3-7c70-42ee-826c-d68ebc99dd67 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:00.522554 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b7c3cac3-7c70-42ee-826c-d68ebc99dd67 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:00.529291 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7c3cac3-7c70-42ee-826c-d68ebc99dd67 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:00.531683 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7c3cac3-7c70-42ee-826c-d68ebc99dd67 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:00.531683 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7c3cac3-7c70-42ee-826c-d68ebc99dd67 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:00.531683 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7c3cac3-7c70-42ee-826c-d68ebc99dd67 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:00.531683 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7c3cac3-7c70-42ee-826c-d68ebc99dd67 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:00.532043 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7c3cac3-7c70-42ee-826c-d68ebc99dd67 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:00.641663 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f979ee37-c35b-475b-897e-c8619d97c15a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:00.642581 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f979ee37-c35b-475b-897e-c8619d97c15a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:00.650162 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f979ee37-c35b-475b-897e-c8619d97c15a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:00.650658 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f979ee37-c35b-475b-897e-c8619d97c15a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:00.651082 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f979ee37-c35b-475b-897e-c8619d97c15a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:00.651894 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f979ee37-c35b-475b-897e-c8619d97c15a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:00.652333 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f979ee37-c35b-475b-897e-c8619d97c15a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:00.652754 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f979ee37-c35b-475b-897e-c8619d97c15a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:00.801794 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f979ee37-c35b-475b-897e-c8619d97c15a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:00.808392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f979ee37-c35b-475b-897e-c8619d97c15a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:00.810096 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f979ee37-c35b-475b-897e-c8619d97c15a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:00.811606 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f979ee37-c35b-475b-897e-c8619d97c15a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1597 microversion: 2.20 time: 0.174515 Aug 30 01:16:00.812176 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 412/785] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:16:00 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1597 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:16:00.834993 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5736c9cf-52ed-4513-8eba-050bdfd0fa61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:00.835480 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5736c9cf-52ed-4513-8eba-050bdfd0fa61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:00.842384 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5736c9cf-52ed-4513-8eba-050bdfd0fa61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:00.842869 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5736c9cf-52ed-4513-8eba-050bdfd0fa61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:00.843295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5736c9cf-52ed-4513-8eba-050bdfd0fa61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:00.843993 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5736c9cf-52ed-4513-8eba-050bdfd0fa61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:00.844440 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5736c9cf-52ed-4513-8eba-050bdfd0fa61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:00.844860 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5736c9cf-52ed-4513-8eba-050bdfd0fa61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:00.923811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5736c9cf-52ed-4513-8eba-050bdfd0fa61 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092563 Aug 30 01:16:00.924928 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 413/786] 10.222.0.52 () {60 vars in 1316 bytes} [Tue Aug 30 01:16:00 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:16:01.012964 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b7c3cac3-7c70-42ee-826c-d68ebc99dd67 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:01.024560 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b7c3cac3-7c70-42ee-826c-d68ebc99dd67 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1363 microversion: 2.1 time: 0.506383 Aug 30 01:16:01.025362 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 374/787] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:00 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1363 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:01.296280 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-17a6058c-67af-478c-8705-daf76985c2f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbaa4795-359a-4a5f-97d8-79d406510720"}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:01.298693 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-17a6058c-67af-478c-8705-daf76985c2f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:01.304709 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-17a6058c-67af-478c-8705-daf76985c2f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:01.305939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-17a6058c-67af-478c-8705-daf76985c2f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:01.306512 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-17a6058c-67af-478c-8705-daf76985c2f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:01.307217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-17a6058c-67af-478c-8705-daf76985c2f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:01.307676 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-17a6058c-67af-478c-8705-daf76985c2f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:01.308103 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-17a6058c-67af-478c-8705-daf76985c2f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:01.312061 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=100 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:01.970049 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-cf23dfb4-b322-4190-bf6b-c4a51a6999af req-09aef0db-1ae0-4a1a-9160-627906510bfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65b743eb-1b3f-458d-ad48-d60c3934ba0d", "tag": "adb8f445-f2e5-41a5-91ba-43406b91be88"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:01.981080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-cf23dfb4-b322-4190-bf6b-c4a51a6999af req-09aef0db-1ae0-4a1a-9160-627906510bfc service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:01.981642 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-cf23dfb4-b322-4190-bf6b-c4a51a6999af req-09aef0db-1ae0-4a1a-9160-627906510bfc service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:01.982104 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-cf23dfb4-b322-4190-bf6b-c4a51a6999af req-09aef0db-1ae0-4a1a-9160-627906510bfc service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:01.995388 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-cf23dfb4-b322-4190-bf6b-c4a51a6999af req-09aef0db-1ae0-4a1a-9160-627906510bfc service nova] Creating event network-changed:adb8f445-f2e5-41a5-91ba-43406b91be88 for instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d on hv-cinder-81571 Aug 30 01:16:02.001929 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-cf23dfb4-b322-4190-bf6b-c4a51a6999af req-09aef0db-1ae0-4a1a-9160-627906510bfc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033941 Aug 30 01:16:02.001929 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 375/788] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:02.046088 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b48d868c-5746-456e-8a5a-fda3781f81b9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:02.046802 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b48d868c-5746-456e-8a5a-fda3781f81b9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:02.053169 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b48d868c-5746-456e-8a5a-fda3781f81b9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:02.053622 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b48d868c-5746-456e-8a5a-fda3781f81b9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:02.054168 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b48d868c-5746-456e-8a5a-fda3781f81b9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:02.054896 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b48d868c-5746-456e-8a5a-fda3781f81b9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:02.055356 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b48d868c-5746-456e-8a5a-fda3781f81b9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:02.056151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b48d868c-5746-456e-8a5a-fda3781f81b9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:02.247066 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b48d868c-5746-456e-8a5a-fda3781f81b9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:02.256083 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b48d868c-5746-456e-8a5a-fda3781f81b9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1363 microversion: 2.1 time: 0.214683 Aug 30 01:16:02.256759 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 376/789] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:02 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:16:02.525146 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-17a6058c-67af-478c-8705-daf76985c2f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "POST /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.232910 Aug 30 01:16:02.525794 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 414/790] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 30 01:16:01 2022] POST /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/os-volume_attachments => generated 194 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:16:03.278141 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-63bfd953-3c73-42ef-8943-5920953fe12c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:03.279121 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-63bfd953-3c73-42ef-8943-5920953fe12c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:03.285613 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63bfd953-3c73-42ef-8943-5920953fe12c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:03.286437 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63bfd953-3c73-42ef-8943-5920953fe12c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:03.286627 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63bfd953-3c73-42ef-8943-5920953fe12c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:03.287294 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63bfd953-3c73-42ef-8943-5920953fe12c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:03.287748 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63bfd953-3c73-42ef-8943-5920953fe12c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:03.288568 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63bfd953-3c73-42ef-8943-5920953fe12c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:03.518790 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-63bfd953-3c73-42ef-8943-5920953fe12c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:03.527246 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-63bfd953-3c73-42ef-8943-5920953fe12c tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1549 microversion: 2.1 time: 0.253721 Aug 30 01:16:03.527843 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 377/791] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:03 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1549 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:03.549588 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ce58a44a-3901-4fa2-bb30-cb272ac49c77 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:03.553473 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ce58a44a-3901-4fa2-bb30-cb272ac49c77 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:03.558024 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ce58a44a-3901-4fa2-bb30-cb272ac49c77 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:03.558515 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ce58a44a-3901-4fa2-bb30-cb272ac49c77 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:03.558951 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ce58a44a-3901-4fa2-bb30-cb272ac49c77 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:03.559652 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ce58a44a-3901-4fa2-bb30-cb272ac49c77 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:03.560103 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ce58a44a-3901-4fa2-bb30-cb272ac49c77 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:03.560521 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ce58a44a-3901-4fa2-bb30-cb272ac49c77 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:03.644623 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ce58a44a-3901-4fa2-bb30-cb272ac49c77 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099890 Aug 30 01:16:03.645262 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 415/792] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 30 01:16:03 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:04.890229 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-10a80dd1-ba22-4d65-87b8-966889cfe538 req-8aea1c60-67c1-49c7-a54c-705878fcf3cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ae3ba30-d38c-4e44-bc40-c9bda178d1b5", "tag": "d73390a3-6a1a-4a0a-9fab-afc8d7d090e9"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:04.890229 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-10a80dd1-ba22-4d65-87b8-966889cfe538 req-8aea1c60-67c1-49c7-a54c-705878fcf3cd service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:04.890229 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-10a80dd1-ba22-4d65-87b8-966889cfe538 req-8aea1c60-67c1-49c7-a54c-705878fcf3cd service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:04.890229 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-10a80dd1-ba22-4d65-87b8-966889cfe538 req-8aea1c60-67c1-49c7-a54c-705878fcf3cd service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:04.900798 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-10a80dd1-ba22-4d65-87b8-966889cfe538 req-8aea1c60-67c1-49c7-a54c-705878fcf3cd service nova] Creating event network-changed:d73390a3-6a1a-4a0a-9fab-afc8d7d090e9 for instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 on hv-cinder-81571 Aug 30 01:16:04.905828 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-10a80dd1-ba22-4d65-87b8-966889cfe538 req-8aea1c60-67c1-49c7-a54c-705878fcf3cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030874 Aug 30 01:16:04.906461 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 378/793] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:11.187644 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=2 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:11.191650 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5de709f3-0bb2-43a0-8bed-7ce962785cfa tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:11.192254 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5de709f3-0bb2-43a0-8bed-7ce962785cfa tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:11.198295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5de709f3-0bb2-43a0-8bed-7ce962785cfa tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:11.198816 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5de709f3-0bb2-43a0-8bed-7ce962785cfa tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:11.199214 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5de709f3-0bb2-43a0-8bed-7ce962785cfa tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:11.199932 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5de709f3-0bb2-43a0-8bed-7ce962785cfa tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:11.200389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5de709f3-0bb2-43a0-8bed-7ce962785cfa tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:11.200817 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5de709f3-0bb2-43a0-8bed-7ce962785cfa tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:11.332424 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5de709f3-0bb2-43a0-8bed-7ce962785cfa tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:11.341867 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5de709f3-0bb2-43a0-8bed-7ce962785cfa tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1592 microversion: 2.1 time: 0.155723 Aug 30 01:16:11.342439 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 416/794] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:11 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1592 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:12.231016 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-beaa019c-598a-43f5-b023-802d9bcc2edf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:12.231016 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-beaa019c-598a-43f5-b023-802d9bcc2edf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:12.235219 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-beaa019c-598a-43f5-b023-802d9bcc2edf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:12.235712 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-beaa019c-598a-43f5-b023-802d9bcc2edf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:12.236146 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-beaa019c-598a-43f5-b023-802d9bcc2edf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:12.236844 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-beaa019c-598a-43f5-b023-802d9bcc2edf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:12.237298 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-beaa019c-598a-43f5-b023-802d9bcc2edf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:12.237723 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-beaa019c-598a-43f5-b023-802d9bcc2edf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:12.321670 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-beaa019c-598a-43f5-b023-802d9bcc2edf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lazy-loading 'services' on Instance uuid 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:16:12.532373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-beaa019c-598a-43f5-b023-802d9bcc2edf tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-volume_attachments/47f563a0-540e-4e8c-8f8a-6a8f6619e06e" status: 202 len: 0 microversion: 2.1 time: 0.309817 Aug 30 01:16:12.533012 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 379/795] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 30 01:16:12 2022] DELETE /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-volume_attachments/47f563a0-540e-4e8c-8f8a-6a8f6619e06e => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:16:12.548730 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-90ffe997-6b12-4878-b8c0-155cfe3d42ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:12.551046 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-90ffe997-6b12-4878-b8c0-155cfe3d42ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:12.557874 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-90ffe997-6b12-4878-b8c0-155cfe3d42ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:12.560321 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-90ffe997-6b12-4878-b8c0-155cfe3d42ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:12.560321 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-90ffe997-6b12-4878-b8c0-155cfe3d42ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:12.560321 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-90ffe997-6b12-4878-b8c0-155cfe3d42ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:12.560321 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-90ffe997-6b12-4878-b8c0-155cfe3d42ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:12.560894 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-90ffe997-6b12-4878-b8c0-155cfe3d42ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:12.593009 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-90ffe997-6b12-4878-b8c0-155cfe3d42ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048383 Aug 30 01:16:12.593591 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 417/796] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:16:12 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:13.405570 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-3cacefd3-87c6-4139-bb84-5bc87011e160 req-7bca0f95-f034-4992-b5e7-67c835102027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfb98683-87f8-47ff-89d6-4d74e9f961d1", "tag": "fb9f85b8-7682-4117-938b-7225f55cd3b2"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:13.417243 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3cacefd3-87c6-4139-bb84-5bc87011e160 req-7bca0f95-f034-4992-b5e7-67c835102027 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:13.418261 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3cacefd3-87c6-4139-bb84-5bc87011e160 req-7bca0f95-f034-4992-b5e7-67c835102027 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:13.418898 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3cacefd3-87c6-4139-bb84-5bc87011e160 req-7bca0f95-f034-4992-b5e7-67c835102027 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:13.431594 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-3cacefd3-87c6-4139-bb84-5bc87011e160 req-7bca0f95-f034-4992-b5e7-67c835102027 service nova] Creating event network-changed:fb9f85b8-7682-4117-938b-7225f55cd3b2 for instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 on hv-cinder-81571 Aug 30 01:16:13.436841 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-3cacefd3-87c6-4139-bb84-5bc87011e160 req-7bca0f95-f034-4992-b5e7-67c835102027 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035906 Aug 30 01:16:13.437515 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 380/797] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:13.608480 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-503b759f-21dc-48d3-a1bd-625e8d8b42f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:13.611206 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-503b759f-21dc-48d3-a1bd-625e8d8b42f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:13.618410 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-503b759f-21dc-48d3-a1bd-625e8d8b42f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:13.619275 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-503b759f-21dc-48d3-a1bd-625e8d8b42f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:13.619835 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-503b759f-21dc-48d3-a1bd-625e8d8b42f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:13.620648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-503b759f-21dc-48d3-a1bd-625e8d8b42f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:13.621339 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-503b759f-21dc-48d3-a1bd-625e8d8b42f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:13.621873 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-503b759f-21dc-48d3-a1bd-625e8d8b42f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:13.654641 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-503b759f-21dc-48d3-a1bd-625e8d8b42f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052274 Aug 30 01:16:13.655366 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 418/798] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:16:13 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:14.668353 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9757b502-b8d9-4478-8e7d-b914a73837b2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:14.670735 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9757b502-b8d9-4478-8e7d-b914a73837b2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:14.673228 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=66 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:14.678217 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9757b502-b8d9-4478-8e7d-b914a73837b2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:14.681258 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9757b502-b8d9-4478-8e7d-b914a73837b2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:14.681258 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9757b502-b8d9-4478-8e7d-b914a73837b2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:14.681258 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9757b502-b8d9-4478-8e7d-b914a73837b2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:14.681828 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9757b502-b8d9-4478-8e7d-b914a73837b2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:14.682269 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9757b502-b8d9-4478-8e7d-b914a73837b2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:14.712683 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9757b502-b8d9-4478-8e7d-b914a73837b2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049007 Aug 30 01:16:14.713240 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 381/799] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:16:14 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:16:14.790949 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-15bfbd7c-2fc5-48a4-8168-62b56b0c4a2b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:14.791780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-15bfbd7c-2fc5-48a4-8168-62b56b0c4a2b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:14.798372 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15bfbd7c-2fc5-48a4-8168-62b56b0c4a2b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:14.798857 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15bfbd7c-2fc5-48a4-8168-62b56b0c4a2b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:14.799295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15bfbd7c-2fc5-48a4-8168-62b56b0c4a2b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:14.799984 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15bfbd7c-2fc5-48a4-8168-62b56b0c4a2b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:14.800438 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15bfbd7c-2fc5-48a4-8168-62b56b0c4a2b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:14.800862 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-15bfbd7c-2fc5-48a4-8168-62b56b0c4a2b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:14.828021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-15bfbd7c-2fc5-48a4-8168-62b56b0c4a2b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Going to try to terminate instance {{(pid=121233) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:16:15.171809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-15bfbd7c-2fc5-48a4-8168-62b56b0c4a2b tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 204 len: 0 microversion: 2.1 time: 0.385065 Aug 30 01:16:15.172608 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 419/800] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:16:14 2022] DELETE /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:15.181500 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0912cc30-dc99-41f8-90ca-229022ac2df0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:15.182166 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0912cc30-dc99-41f8-90ca-229022ac2df0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:15.188423 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0912cc30-dc99-41f8-90ca-229022ac2df0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:15.188907 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0912cc30-dc99-41f8-90ca-229022ac2df0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:15.190209 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0912cc30-dc99-41f8-90ca-229022ac2df0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:15.190209 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0912cc30-dc99-41f8-90ca-229022ac2df0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:15.190655 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0912cc30-dc99-41f8-90ca-229022ac2df0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:15.191091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0912cc30-dc99-41f8-90ca-229022ac2df0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:15.326851 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0912cc30-dc99-41f8-90ca-229022ac2df0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:15.334707 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0912cc30-dc99-41f8-90ca-229022ac2df0 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1689 microversion: 2.1 time: 0.157752 Aug 30 01:16:15.335279 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 382/801] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:15 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:16.223682 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-69631bca-1c83-4a06-bb7d-6dcf468eeb81 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1421496511"}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:16.224308 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-69631bca-1c83-4a06-bb7d-6dcf468eeb81 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:16.228127 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:16.233956 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69631bca-1c83-4a06-bb7d-6dcf468eeb81 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:16.234447 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69631bca-1c83-4a06-bb7d-6dcf468eeb81 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:16.234883 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69631bca-1c83-4a06-bb7d-6dcf468eeb81 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:16.235585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69631bca-1c83-4a06-bb7d-6dcf468eeb81 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:16.236038 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69631bca-1c83-4a06-bb7d-6dcf468eeb81 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:16.236596 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-69631bca-1c83-4a06-bb7d-6dcf468eeb81 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:16.355565 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-01faf181-715f-4362-aa95-1506da6db23f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:16.356768 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-01faf181-715f-4362-aa95-1506da6db23f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:16.363413 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01faf181-715f-4362-aa95-1506da6db23f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:16.363899 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01faf181-715f-4362-aa95-1506da6db23f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:16.364447 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01faf181-715f-4362-aa95-1506da6db23f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:16.365145 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01faf181-715f-4362-aa95-1506da6db23f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:16.365600 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01faf181-715f-4362-aa95-1506da6db23f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:16.366061 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01faf181-715f-4362-aa95-1506da6db23f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:16.370783 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.network.security_group_api [None req-69631bca-1c83-4a06-bb7d-6dcf468eeb81 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Adding security group 3c05186b-c954-426b-bdda-89534f7db01a to port fb9f85b8-7682-4117-938b-7225f55cd3b2 Aug 30 01:16:16.505379 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-01faf181-715f-4362-aa95-1506da6db23f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:16.513880 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-01faf181-715f-4362-aa95-1506da6db23f tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1689 microversion: 2.1 time: 0.162501 Aug 30 01:16:16.527586 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 383/802] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:16 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:16:17.089467 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-69631bca-1c83-4a06-bb7d-6dcf468eeb81 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "POST /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/action" status: 202 len: 0 microversion: 2.1 time: 0.870069 Aug 30 01:16:17.090144 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 420/803] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 30 01:16:16 2022] POST /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/action => generated 0 bytes in 872 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:16:17.097626 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-a36e1148-a54d-4e47-9687-729abb03b036 req-c1cd4ac3-b4b4-443e-8871-31319c3f31df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfb98683-87f8-47ff-89d6-4d74e9f961d1", "tag": "fb9f85b8-7682-4117-938b-7225f55cd3b2"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:17.107352 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-a36e1148-a54d-4e47-9687-729abb03b036 req-c1cd4ac3-b4b4-443e-8871-31319c3f31df service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:17.107829 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-a36e1148-a54d-4e47-9687-729abb03b036 req-c1cd4ac3-b4b4-443e-8871-31319c3f31df service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:17.108096 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a5732c58-2c7a-4414-840e-2592be351c31 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:17.108279 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-a36e1148-a54d-4e47-9687-729abb03b036 req-c1cd4ac3-b4b4-443e-8871-31319c3f31df service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:17.108718 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a5732c58-2c7a-4414-840e-2592be351c31 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:17.115352 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a5732c58-2c7a-4414-840e-2592be351c31 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:17.115850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a5732c58-2c7a-4414-840e-2592be351c31 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:17.116288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a5732c58-2c7a-4414-840e-2592be351c31 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:17.116999 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a5732c58-2c7a-4414-840e-2592be351c31 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:17.118147 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a5732c58-2c7a-4414-840e-2592be351c31 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:17.127363 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a5732c58-2c7a-4414-840e-2592be351c31 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:17.127703 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-a36e1148-a54d-4e47-9687-729abb03b036 req-c1cd4ac3-b4b4-443e-8871-31319c3f31df service nova] Creating event network-changed:fb9f85b8-7682-4117-938b-7225f55cd3b2 for instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 on hv-cinder-81571 Aug 30 01:16:17.127703 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-a36e1148-a54d-4e47-9687-729abb03b036 req-c1cd4ac3-b4b4-443e-8871-31319c3f31df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033377 Aug 30 01:16:17.128386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 384/804] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:16:17.272667 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a5732c58-2c7a-4414-840e-2592be351c31 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:17.281573 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a5732c58-2c7a-4414-840e-2592be351c31 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1758 microversion: 2.1 time: 0.177141 Aug 30 01:16:17.282259 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 421/805] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:17 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:17.536578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-acf4bff7-aee5-45b5-8cfe-5a1e7d0b5655 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:17.537243 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-acf4bff7-aee5-45b5-8cfe-5a1e7d0b5655 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:17.544759 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-acf4bff7-aee5-45b5-8cfe-5a1e7d0b5655 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:17.545248 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-acf4bff7-aee5-45b5-8cfe-5a1e7d0b5655 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:17.545691 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-acf4bff7-aee5-45b5-8cfe-5a1e7d0b5655 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:17.546416 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-acf4bff7-aee5-45b5-8cfe-5a1e7d0b5655 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:17.546875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-acf4bff7-aee5-45b5-8cfe-5a1e7d0b5655 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:17.547299 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-acf4bff7-aee5-45b5-8cfe-5a1e7d0b5655 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:17.689290 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-acf4bff7-aee5-45b5-8cfe-5a1e7d0b5655 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:17.698177 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-acf4bff7-aee5-45b5-8cfe-5a1e7d0b5655 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1689 microversion: 2.1 time: 0.166400 Aug 30 01:16:17.698763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 385/806] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:17 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:18.718571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-67b5d264-2475-4122-bcd6-5f1f13ad94f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:18.719175 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-67b5d264-2475-4122-bcd6-5f1f13ad94f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:18.725539 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-67b5d264-2475-4122-bcd6-5f1f13ad94f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:18.726051 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-67b5d264-2475-4122-bcd6-5f1f13ad94f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:18.726485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-67b5d264-2475-4122-bcd6-5f1f13ad94f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:18.727243 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-67b5d264-2475-4122-bcd6-5f1f13ad94f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:18.727638 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-67b5d264-2475-4122-bcd6-5f1f13ad94f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:18.728060 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-67b5d264-2475-4122-bcd6-5f1f13ad94f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:18.871072 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-67b5d264-2475-4122-bcd6-5f1f13ad94f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:18.881243 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-67b5d264-2475-4122-bcd6-5f1f13ad94f2 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1689 microversion: 2.1 time: 0.166543 Aug 30 01:16:18.881840 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 422/807] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:18 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:19.903426 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c3414ae3-35b7-4350-8fb7-e5bf1ca1373c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:19.904046 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c3414ae3-35b7-4350-8fb7-e5bf1ca1373c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:19.910705 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3414ae3-35b7-4350-8fb7-e5bf1ca1373c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:19.911191 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3414ae3-35b7-4350-8fb7-e5bf1ca1373c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:19.911631 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3414ae3-35b7-4350-8fb7-e5bf1ca1373c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:19.912327 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3414ae3-35b7-4350-8fb7-e5bf1ca1373c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:19.912798 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3414ae3-35b7-4350-8fb7-e5bf1ca1373c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:19.913227 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3414ae3-35b7-4350-8fb7-e5bf1ca1373c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:20.195095 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c3414ae3-35b7-4350-8fb7-e5bf1ca1373c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:20.203081 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c3414ae3-35b7-4350-8fb7-e5bf1ca1373c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1689 microversion: 2.1 time: 0.304150 Aug 30 01:16:20.203769 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 386/808] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:19 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1689 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:21.134315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-4047ccd4-c3ec-4c72-a11f-645f6426f1a9 req-b3760b21-f177-47e2-8df2-6e1fc196b09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc62a7d-bbdb-4131-b8bc-ab85635ad17d", "name": "network-vif-deleted", "tag": "074c3418-a64e-4b71-96d8-7600e741330d"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:21.144985 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-4047ccd4-c3ec-4c72-a11f-645f6426f1a9 req-b3760b21-f177-47e2-8df2-6e1fc196b09f service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:21.145553 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-4047ccd4-c3ec-4c72-a11f-645f6426f1a9 req-b3760b21-f177-47e2-8df2-6e1fc196b09f service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:21.146289 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-4047ccd4-c3ec-4c72-a11f-645f6426f1a9 req-b3760b21-f177-47e2-8df2-6e1fc196b09f service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:21.165363 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-4047ccd4-c3ec-4c72-a11f-645f6426f1a9 req-b3760b21-f177-47e2-8df2-6e1fc196b09f service nova] Creating event network-vif-deleted:074c3418-a64e-4b71-96d8-7600e741330d for instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d on hv-cinder-81571 Aug 30 01:16:21.171553 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-4047ccd4-c3ec-4c72-a11f-645f6426f1a9 req-b3760b21-f177-47e2-8df2-6e1fc196b09f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101656 Aug 30 01:16:21.172384 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 423/809] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:21.224463 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d691d0f0-950b-4b4f-973f-9615fd5ab2a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:21.226326 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d691d0f0-950b-4b4f-973f-9615fd5ab2a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:21.233186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d691d0f0-950b-4b4f-973f-9615fd5ab2a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:21.233751 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d691d0f0-950b-4b4f-973f-9615fd5ab2a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:21.234202 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d691d0f0-950b-4b4f-973f-9615fd5ab2a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:21.235062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d691d0f0-950b-4b4f-973f-9615fd5ab2a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:21.235522 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d691d0f0-950b-4b4f-973f-9615fd5ab2a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:21.235944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d691d0f0-950b-4b4f-973f-9615fd5ab2a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:21.240947 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:21.306358 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d691d0f0-950b-4b4f-973f-9615fd5ab2a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:21.333029 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d691d0f0-950b-4b4f-973f-9615fd5ab2a9 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1622 microversion: 2.1 time: 0.112375 Aug 30 01:16:21.338158 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 387/810] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:21 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1622 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:22.356491 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-93a6f6e0-15d7-462e-8b7e-412a28983ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:22.357202 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-93a6f6e0-15d7-462e-8b7e-412a28983ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:22.363774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-93a6f6e0-15d7-462e-8b7e-412a28983ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:22.364370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-93a6f6e0-15d7-462e-8b7e-412a28983ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:22.364710 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-93a6f6e0-15d7-462e-8b7e-412a28983ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:22.365389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-93a6f6e0-15d7-462e-8b7e-412a28983ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:22.365897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-93a6f6e0-15d7-462e-8b7e-412a28983ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:22.366329 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-93a6f6e0-15d7-462e-8b7e-412a28983ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:22.398656 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-93a6f6e0-15d7-462e-8b7e-412a28983ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:22.399275 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-93a6f6e0-15d7-462e-8b7e-412a28983ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:22.399724 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-93a6f6e0-15d7-462e-8b7e-412a28983ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:22.400173 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-93a6f6e0-15d7-462e-8b7e-412a28983ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lazy-loading 'fault' on Instance uuid 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:16:22.443909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-93a6f6e0-15d7-462e-8b7e-412a28983ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:22.451787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-93a6f6e0-15d7-462e-8b7e-412a28983ed8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 200 len: 1336 microversion: 2.1 time: 0.100871 Aug 30 01:16:22.452364 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 424/811] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:22 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 1336 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:23.472447 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-46eac3af-012b-40a4-be2b-073ac0521841 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:23.473048 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-46eac3af-012b-40a4-be2b-073ac0521841 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:23.480845 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46eac3af-012b-40a4-be2b-073ac0521841 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:23.481325 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46eac3af-012b-40a4-be2b-073ac0521841 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:23.481777 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46eac3af-012b-40a4-be2b-073ac0521841 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:23.482476 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46eac3af-012b-40a4-be2b-073ac0521841 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:23.482929 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46eac3af-012b-40a4-be2b-073ac0521841 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:23.483346 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46eac3af-012b-40a4-be2b-073ac0521841 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:23.498500 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-46eac3af-012b-40a4-be2b-073ac0521841 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] HTTP exception thrown: Instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d could not be found. Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-46eac3af-012b-40a4-be2b-073ac0521841 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Request method failure captured: Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d HTTP/1.1 Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWOeQEJvJe1oPgcAM0CJuHJZAsxaDOqgO7QH27qraPSKUTsAC4XPuYjUu6EVHrur_xArtWyqCb5JWbnssK7EJqykgUjLDeCSyIoPGge8kiHjsHWrlFHhD6AcbhjW0-wlasX1OPO3NkTkkmdkpMoIb_wVF9xmCsbss_a5nytHoL3C3Tw Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 9f0605a8a2fe48e49a410127b5f3b32c Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1432841125 Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:16:23.500186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:16:23.501983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:16:23.501983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1432841125 Aug 30 01:16:23.501983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 9f0605a8a2fe48e49a410127b5f3b32c Aug 30 01:16:23.501983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1432841125 Aug 30 01:16:23.501983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-ServerRescueNegativeTestJSON-1432841125-project Aug 30 01:16:23.501983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:16:23.501983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:16:23.501983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 76ea3ed3bb2b412093004c7e0f49c7ce Aug 30 01:16:23.501983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1432841125-project Aug 30 01:16:23.501983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:16:23.501983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d could not be found. Aug 30 01:16:23.501983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': '3cc62a7d-bbdb-4131-b8bc-ab85635ad17d'} Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d could not be found. Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:16:23.502826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d could not be found. Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d could not be found. Aug 30 01:16:23.504062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:16:23.505257 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-46eac3af-012b-40a4-be2b-073ac0521841 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Returning 404 to user: Instance 3cc62a7d-bbdb-4131-b8bc-ab85635ad17d could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:16:23.505257 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-46eac3af-012b-40a4-be2b-073ac0521841 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d" status: 404 len: 111 microversion: 2.1 time: 0.032954 Aug 30 01:16:23.505257 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 388/812] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:23 2022] GET /compute/v2.1/servers/3cc62a7d-bbdb-4131-b8bc-ab85635ad17d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:23.510460 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f8bc1889-8550-43d1-a3da-995f70bb33fd tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '.version_select at 0x7fd71ce799d0>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:23.584726 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f8bc1889-8550-43d1-a3da-995f70bb33fd tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1208263142" status: 202 len: 0 microversion: 2.1 time: 0.078016 Aug 30 01:16:23.585379 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 425/813] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Aug 30 01:16:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1208263142 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:16:23.679075 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2f38fd37-30d2-452d-8a61-ed9f3b638145 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:23.679591 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2f38fd37-30d2-452d-8a61-ed9f3b638145 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:23.685829 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f38fd37-30d2-452d-8a61-ed9f3b638145 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:23.686256 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f38fd37-30d2-452d-8a61-ed9f3b638145 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:23.686698 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f38fd37-30d2-452d-8a61-ed9f3b638145 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:23.687399 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f38fd37-30d2-452d-8a61-ed9f3b638145 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:23.687847 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f38fd37-30d2-452d-8a61-ed9f3b638145 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:23.688275 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f38fd37-30d2-452d-8a61-ed9f3b638145 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:23.714134 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2f38fd37-30d2-452d-8a61-ed9f3b638145 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/ips" status: 200 len: 150 microversion: 2.1 time: 0.093979 Aug 30 01:16:23.714847 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 389/814] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 30 01:16:23 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/ips => generated 150 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:25.372178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0eb864bf-69e9-4584-83e6-fec96d3f8979 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09f7a1e7-507f-4643-a1c2-03445acdd09f"}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:25.374520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0eb864bf-69e9-4584-83e6-fec96d3f8979 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:25.381242 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0eb864bf-69e9-4584-83e6-fec96d3f8979 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:25.389429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0eb864bf-69e9-4584-83e6-fec96d3f8979 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:25.389429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0eb864bf-69e9-4584-83e6-fec96d3f8979 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:25.389429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0eb864bf-69e9-4584-83e6-fec96d3f8979 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:25.389429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0eb864bf-69e9-4584-83e6-fec96d3f8979 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:25.389885 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0eb864bf-69e9-4584-83e6-fec96d3f8979 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:26.266796 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0eb864bf-69e9-4584-83e6-fec96d3f8979 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "POST /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.899053 Aug 30 01:16:26.267528 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 426/815] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 30 01:16:25 2022] POST /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/os-volume_attachments => generated 194 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:27.035900 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-725dc4d3-66ef-4f89-83f3-6344b1173665 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:27.036396 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-725dc4d3-66ef-4f89-83f3-6344b1173665 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:27.043497 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-725dc4d3-66ef-4f89-83f3-6344b1173665 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:27.043973 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-725dc4d3-66ef-4f89-83f3-6344b1173665 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:27.044408 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-725dc4d3-66ef-4f89-83f3-6344b1173665 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:27.045093 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-725dc4d3-66ef-4f89-83f3-6344b1173665 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:27.045549 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-725dc4d3-66ef-4f89-83f3-6344b1173665 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:27.046002 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-725dc4d3-66ef-4f89-83f3-6344b1173665 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:27.074279 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-725dc4d3-66ef-4f89-83f3-6344b1173665 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:16:27.360750 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-725dc4d3-66ef-4f89-83f3-6344b1173665 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 204 len: 0 microversion: 2.1 time: 0.328381 Aug 30 01:16:27.361387 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 390/816] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:16:27 2022] DELETE /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:27.371451 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-30352115-dc48-4d94-941c-30edefa82b6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:27.372186 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-30352115-dc48-4d94-941c-30edefa82b6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:27.378775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-30352115-dc48-4d94-941c-30edefa82b6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:27.379322 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-30352115-dc48-4d94-941c-30edefa82b6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:27.379761 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-30352115-dc48-4d94-941c-30edefa82b6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:27.380459 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-30352115-dc48-4d94-941c-30edefa82b6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:27.380917 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-30352115-dc48-4d94-941c-30edefa82b6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:27.381437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-30352115-dc48-4d94-941c-30edefa82b6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:27.521754 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-30352115-dc48-4d94-941c-30edefa82b6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:27.530794 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-30352115-dc48-4d94-941c-30edefa82b6d tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1508 microversion: 2.1 time: 0.164382 Aug 30 01:16:27.531582 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 427/817] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:27 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:28.553222 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7551fc18-d9a9-472c-aa1a-aba23aaa1455 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:28.553936 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7551fc18-d9a9-472c-aa1a-aba23aaa1455 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:28.560455 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7551fc18-d9a9-472c-aa1a-aba23aaa1455 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:28.560931 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7551fc18-d9a9-472c-aa1a-aba23aaa1455 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:28.561363 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7551fc18-d9a9-472c-aa1a-aba23aaa1455 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:28.562092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7551fc18-d9a9-472c-aa1a-aba23aaa1455 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:28.562547 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7551fc18-d9a9-472c-aa1a-aba23aaa1455 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:28.562969 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7551fc18-d9a9-472c-aa1a-aba23aaa1455 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:28.694036 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7551fc18-d9a9-472c-aa1a-aba23aaa1455 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:28.702587 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7551fc18-d9a9-472c-aa1a-aba23aaa1455 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1508 microversion: 2.1 time: 0.153584 Aug 30 01:16:28.703172 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 391/818] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:28 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:29.724324 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6c25b12b-9888-46f6-9e8b-baf3ddc873d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:29.724881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6c25b12b-9888-46f6-9e8b-baf3ddc873d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:29.731953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c25b12b-9888-46f6-9e8b-baf3ddc873d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:29.732436 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c25b12b-9888-46f6-9e8b-baf3ddc873d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:29.732912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c25b12b-9888-46f6-9e8b-baf3ddc873d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:29.733605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c25b12b-9888-46f6-9e8b-baf3ddc873d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:29.734093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c25b12b-9888-46f6-9e8b-baf3ddc873d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:29.734523 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c25b12b-9888-46f6-9e8b-baf3ddc873d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:29.753083 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:29.868339 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6c25b12b-9888-46f6-9e8b-baf3ddc873d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:29.876571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6c25b12b-9888-46f6-9e8b-baf3ddc873d7 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1508 microversion: 2.1 time: 0.156310 Aug 30 01:16:29.877138 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 428/819] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:29 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:30.898373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9db19343-c612-4760-ac19-2be7cc414356 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:30.899059 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9db19343-c612-4760-ac19-2be7cc414356 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:30.907166 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9db19343-c612-4760-ac19-2be7cc414356 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:30.907647 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9db19343-c612-4760-ac19-2be7cc414356 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:30.908109 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9db19343-c612-4760-ac19-2be7cc414356 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:30.908908 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9db19343-c612-4760-ac19-2be7cc414356 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:30.909359 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9db19343-c612-4760-ac19-2be7cc414356 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:30.909810 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9db19343-c612-4760-ac19-2be7cc414356 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:31.150084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9db19343-c612-4760-ac19-2be7cc414356 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:31.157718 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9db19343-c612-4760-ac19-2be7cc414356 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1508 microversion: 2.1 time: 0.263765 Aug 30 01:16:31.158523 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 392/820] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:30 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1508 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:31.431764 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-69a1251d-812f-49cb-a55a-113ef9988020 req-3742ffb8-398f-4d39-a391-521ca91cd394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b016168d-f295-4bb4-9da1-36472ad69576", "name": "network-vif-deleted", "tag": "beaab680-9f79-4900-9963-851c36bf37f9"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:31.445284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-69a1251d-812f-49cb-a55a-113ef9988020 req-3742ffb8-398f-4d39-a391-521ca91cd394 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:31.445786 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-69a1251d-812f-49cb-a55a-113ef9988020 req-3742ffb8-398f-4d39-a391-521ca91cd394 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:31.446222 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-69a1251d-812f-49cb-a55a-113ef9988020 req-3742ffb8-398f-4d39-a391-521ca91cd394 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:31.458723 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-69a1251d-812f-49cb-a55a-113ef9988020 req-3742ffb8-398f-4d39-a391-521ca91cd394 service nova] Creating event network-vif-deleted:beaab680-9f79-4900-9963-851c36bf37f9 for instance b016168d-f295-4bb4-9da1-36472ad69576 on hv-cinder-81571 Aug 30 01:16:31.464043 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-69a1251d-812f-49cb-a55a-113ef9988020 req-3742ffb8-398f-4d39-a391-521ca91cd394 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040088 Aug 30 01:16:31.464943 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 429/821] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:32.178961 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f54c7ca5-826d-4ce8-aa57-846fbeb6422c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:32.179788 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f54c7ca5-826d-4ce8-aa57-846fbeb6422c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:32.187123 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f54c7ca5-826d-4ce8-aa57-846fbeb6422c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:32.187622 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f54c7ca5-826d-4ce8-aa57-846fbeb6422c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:32.188066 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f54c7ca5-826d-4ce8-aa57-846fbeb6422c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:32.188773 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f54c7ca5-826d-4ce8-aa57-846fbeb6422c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:32.189303 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f54c7ca5-826d-4ce8-aa57-846fbeb6422c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:32.189748 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f54c7ca5-826d-4ce8-aa57-846fbeb6422c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:32.221087 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f54c7ca5-826d-4ce8-aa57-846fbeb6422c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:32.221483 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f54c7ca5-826d-4ce8-aa57-846fbeb6422c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:32.221959 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f54c7ca5-826d-4ce8-aa57-846fbeb6422c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:32.222407 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-f54c7ca5-826d-4ce8-aa57-846fbeb6422c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lazy-loading 'fault' on Instance uuid b016168d-f295-4bb4-9da1-36472ad69576 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:16:32.267263 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f54c7ca5-826d-4ce8-aa57-846fbeb6422c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:32.274908 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f54c7ca5-826d-4ce8-aa57-846fbeb6422c tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 200 len: 1311 microversion: 2.1 time: 0.099957 Aug 30 01:16:32.275471 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 393/822] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:32 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:33.296474 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-07d3f856-48d9-45e7-999f-9d4a82a767f8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:33.297162 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-07d3f856-48d9-45e7-999f-9d4a82a767f8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: b016168d-f295-4bb4-9da1-36472ad69576] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:33.303927 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07d3f856-48d9-45e7-999f-9d4a82a767f8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:33.304423 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07d3f856-48d9-45e7-999f-9d4a82a767f8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:33.304854 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07d3f856-48d9-45e7-999f-9d4a82a767f8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:33.305535 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07d3f856-48d9-45e7-999f-9d4a82a767f8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:33.306015 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07d3f856-48d9-45e7-999f-9d4a82a767f8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:33.306439 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-07d3f856-48d9-45e7-999f-9d4a82a767f8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:33.319908 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-07d3f856-48d9-45e7-999f-9d4a82a767f8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] HTTP exception thrown: Instance b016168d-f295-4bb4-9da1-36472ad69576 could not be found. Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-07d3f856-48d9-45e7-999f-9d4a82a767f8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Request method failure captured: Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 HTTP/1.1 Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOeQEJvJe1oPgcAM0CJuHJZAsxaDOqgO7QH27qraPSKUTsAC4XPuYjUu6EVHrur_xArtWyqCb5JWbnssK7EJqykgUjLDeCSyIoPGge8kiHjsHWrlFHhD6AcbhjW0-wlasX1OPO3NkTkkmdkpMoIb_wVF9xmCsbss_a5nytHoL3C3Tw Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 9f0605a8a2fe48e49a410127b5f3b32c Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1432841125 Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:16:33.321519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:16:33.323134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:16:33.323134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1432841125 Aug 30 01:16:33.323134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 9f0605a8a2fe48e49a410127b5f3b32c Aug 30 01:16:33.323134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1432841125 Aug 30 01:16:33.323134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-ServerRescueNegativeTestJSON-1432841125-project Aug 30 01:16:33.323134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:16:33.323134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:16:33.323134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 76ea3ed3bb2b412093004c7e0f49c7ce Aug 30 01:16:33.323134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1432841125-project Aug 30 01:16:33.323134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:16:33.323134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance b016168d-f295-4bb4-9da1-36472ad69576 could not be found. Aug 30 01:16:33.323134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': 'b016168d-f295-4bb4-9da1-36472ad69576'} Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b016168d-f295-4bb4-9da1-36472ad69576 could not be found. Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:16:33.324032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b016168d-f295-4bb4-9da1-36472ad69576 could not be found. Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b016168d-f295-4bb4-9da1-36472ad69576 could not be found. Aug 30 01:16:33.326284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:16:33.327618 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-07d3f856-48d9-45e7-999f-9d4a82a767f8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Returning 404 to user: Instance b016168d-f295-4bb4-9da1-36472ad69576 could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:16:33.327618 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-07d3f856-48d9-45e7-999f-9d4a82a767f8 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576" status: 404 len: 111 microversion: 2.1 time: 0.030783 Aug 30 01:16:33.327618 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 430/823] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:33 2022] GET /compute/v2.1/servers/b016168d-f295-4bb4-9da1-36472ad69576 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:33.332104 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-11c8580b-b39e-468e-9956-f7a019494a9e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:33.332601 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-11c8580b-b39e-468e-9956-f7a019494a9e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:33.338955 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-11c8580b-b39e-468e-9956-f7a019494a9e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:33.339436 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-11c8580b-b39e-468e-9956-f7a019494a9e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:33.339870 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-11c8580b-b39e-468e-9956-f7a019494a9e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:33.341203 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-11c8580b-b39e-468e-9956-f7a019494a9e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:33.341652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-11c8580b-b39e-468e-9956-f7a019494a9e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:33.342102 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-11c8580b-b39e-468e-9956-f7a019494a9e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:33.367483 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-11c8580b-b39e-468e-9956-f7a019494a9e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:16:33.781716 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-11c8580b-b39e-468e-9956-f7a019494a9e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 204 len: 0 microversion: 2.1 time: 0.453174 Aug 30 01:16:33.782378 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 394/824] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:16:33 2022] DELETE /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:33.790325 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-47a47c36-fd14-4f12-b741-f79659a0b4ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:33.791233 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-47a47c36-fd14-4f12-b741-f79659a0b4ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:33.798906 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-47a47c36-fd14-4f12-b741-f79659a0b4ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:33.801846 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-47a47c36-fd14-4f12-b741-f79659a0b4ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:33.801846 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-47a47c36-fd14-4f12-b741-f79659a0b4ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:33.801846 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-47a47c36-fd14-4f12-b741-f79659a0b4ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:33.801846 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-47a47c36-fd14-4f12-b741-f79659a0b4ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:33.802282 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-47a47c36-fd14-4f12-b741-f79659a0b4ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:33.930179 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-47a47c36-fd14-4f12-b741-f79659a0b4ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:33.938637 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-47a47c36-fd14-4f12-b741-f79659a0b4ef tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.152153 Aug 30 01:16:33.939199 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 431/825] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:33 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:34.960092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8d4faa42-482f-40b7-9243-81d8b9ac973e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:34.960796 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8d4faa42-482f-40b7-9243-81d8b9ac973e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:34.967269 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d4faa42-482f-40b7-9243-81d8b9ac973e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:34.967775 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d4faa42-482f-40b7-9243-81d8b9ac973e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:34.968217 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d4faa42-482f-40b7-9243-81d8b9ac973e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:34.968913 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d4faa42-482f-40b7-9243-81d8b9ac973e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:34.969367 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d4faa42-482f-40b7-9243-81d8b9ac973e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:34.969826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d4faa42-482f-40b7-9243-81d8b9ac973e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:35.101607 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8d4faa42-482f-40b7-9243-81d8b9ac973e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:35.109187 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8d4faa42-482f-40b7-9243-81d8b9ac973e tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.153357 Aug 30 01:16:35.110016 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 395/826] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:34 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:36.130422 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0aee2cf8-0a22-4870-89c9-2a6dced4af17 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:36.130991 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0aee2cf8-0a22-4870-89c9-2a6dced4af17 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:36.137465 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0aee2cf8-0a22-4870-89c9-2a6dced4af17 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:36.137983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0aee2cf8-0a22-4870-89c9-2a6dced4af17 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:36.138422 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0aee2cf8-0a22-4870-89c9-2a6dced4af17 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:36.139649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0aee2cf8-0a22-4870-89c9-2a6dced4af17 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:36.140109 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0aee2cf8-0a22-4870-89c9-2a6dced4af17 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:36.140534 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0aee2cf8-0a22-4870-89c9-2a6dced4af17 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:36.273350 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0aee2cf8-0a22-4870-89c9-2a6dced4af17 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:36.282027 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0aee2cf8-0a22-4870-89c9-2a6dced4af17 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.155591 Aug 30 01:16:36.282592 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 432/827] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:36 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:37.304385 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-22e9c28b-6115-40ac-ba88-7e7689e96468 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:37.305005 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-22e9c28b-6115-40ac-ba88-7e7689e96468 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:37.312030 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-22e9c28b-6115-40ac-ba88-7e7689e96468 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:37.312501 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-22e9c28b-6115-40ac-ba88-7e7689e96468 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:37.312934 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-22e9c28b-6115-40ac-ba88-7e7689e96468 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:37.313611 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-22e9c28b-6115-40ac-ba88-7e7689e96468 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:37.314088 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-22e9c28b-6115-40ac-ba88-7e7689e96468 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:37.314511 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-22e9c28b-6115-40ac-ba88-7e7689e96468 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:37.446143 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-22e9c28b-6115-40ac-ba88-7e7689e96468 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:37.454229 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-22e9c28b-6115-40ac-ba88-7e7689e96468 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1522 microversion: 2.1 time: 0.153654 Aug 30 01:16:37.454805 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 396/828] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:37 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:38.037155 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-9a19b391-de3a-4fa9-a1f7-eafb91720db9 req-fd9c0360-1368-4497-9592-0b332952079e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1388d14-c15e-4f95-9b68-944001f0d53a", "name": "network-vif-deleted", "tag": "531e11a0-79a8-4242-9108-a01eaf852ae3"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:38.048557 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-9a19b391-de3a-4fa9-a1f7-eafb91720db9 req-fd9c0360-1368-4497-9592-0b332952079e service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:38.049022 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-9a19b391-de3a-4fa9-a1f7-eafb91720db9 req-fd9c0360-1368-4497-9592-0b332952079e service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:38.049692 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-9a19b391-de3a-4fa9-a1f7-eafb91720db9 req-fd9c0360-1368-4497-9592-0b332952079e service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:38.063383 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-9a19b391-de3a-4fa9-a1f7-eafb91720db9 req-fd9c0360-1368-4497-9592-0b332952079e service nova] Creating event network-vif-deleted:531e11a0-79a8-4242-9108-a01eaf852ae3 for instance e1388d14-c15e-4f95-9b68-944001f0d53a on hv-cinder-81571 Aug 30 01:16:38.068993 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-9a19b391-de3a-4fa9-a1f7-eafb91720db9 req-fd9c0360-1368-4497-9592-0b332952079e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036780 Aug 30 01:16:38.069616 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 433/829] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:38.475572 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-49dabdf8-5231-40f7-a341-f981c12ed3c1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:38.476233 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-49dabdf8-5231-40f7-a341-f981c12ed3c1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:38.484130 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-49dabdf8-5231-40f7-a341-f981c12ed3c1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:38.484979 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-49dabdf8-5231-40f7-a341-f981c12ed3c1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:38.485667 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-49dabdf8-5231-40f7-a341-f981c12ed3c1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:38.487085 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-49dabdf8-5231-40f7-a341-f981c12ed3c1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:38.487732 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-49dabdf8-5231-40f7-a341-f981c12ed3c1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:38.488229 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-49dabdf8-5231-40f7-a341-f981c12ed3c1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:38.530146 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-49dabdf8-5231-40f7-a341-f981c12ed3c1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:38.530900 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-49dabdf8-5231-40f7-a341-f981c12ed3c1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:38.531716 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-49dabdf8-5231-40f7-a341-f981c12ed3c1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:38.532245 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-49dabdf8-5231-40f7-a341-f981c12ed3c1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lazy-loading 'fault' on Instance uuid e1388d14-c15e-4f95-9b68-944001f0d53a {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:16:38.586553 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-49dabdf8-5231-40f7-a341-f981c12ed3c1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ea3ed3bb2b412093004c7e0f49c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0605a8a2fe48e49a410127b5f3b32c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:38.596004 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-49dabdf8-5231-40f7-a341-f981c12ed3c1 tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 200 len: 1312 microversion: 2.1 time: 0.124412 Aug 30 01:16:38.596836 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 397/830] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:38 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 1312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:39.114255 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-8d58fdeb-043b-4098-8c2c-fd45425505fc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09f7a1e7-507f-4643-a1c2-03445acdd09f"}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:39.116705 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-8d58fdeb-043b-4098-8c2c-fd45425505fc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:39.122952 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8d58fdeb-043b-4098-8c2c-fd45425505fc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:39.123995 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8d58fdeb-043b-4098-8c2c-fd45425505fc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:39.124435 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8d58fdeb-043b-4098-8c2c-fd45425505fc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:39.125121 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8d58fdeb-043b-4098-8c2c-fd45425505fc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:39.125572 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8d58fdeb-043b-4098-8c2c-fd45425505fc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:39.126021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8d58fdeb-043b-4098-8c2c-fd45425505fc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:39.209036 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-8d58fdeb-043b-4098-8c2c-fd45425505fc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] HTTP exception thrown: Invalid volume: volume 09f7a1e7-507f-4643-a1c2-03445acdd09f is already attached to instances: 81845d9a-a800-4e7a-8edd-7d6329dd6db2 Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-8d58fdeb-043b-4098-8c2c-fd45425505fc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Request method failure captured: Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: POST /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/os-volume_attachments HTTP/1.1 Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 74 Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOflXbDFJWgbl1TJC3Oy148qXhrnxQzWwozAEpLPUvBjkIue1CYn_oh9imGJ1y-bHs91DQfacqzNdoPNGJGBFUNkjPdHbXnb83IH3jbui9qUN0KpZ__R_CPwPnS8jDFUUiZ7g8Gk1RFVQFkhvoh-4PF9zh2BgfTwME3tmMd22zrKs0 Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:16:39.210780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:16:39.213938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:16:39.213938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:16:39.213938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:16:39.213938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:16:39.213938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:16:39.213938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:16:39.213938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:16:39.213938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 942d175e7e2742728e66fea84c851038 Aug 30 01:16:39.213938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:16:39.213938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Aug 30 01:16:39.213938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {"volumeAttachment": {"volumeId": "09f7a1e7-507f-4643-a1c2-03445acdd09f"}} Aug 30 01:16:39.213938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Invalid volume: volume 09f7a1e7-507f-4643-a1c2-03445acdd09f is already attached to instances: 81845d9a-a800-4e7a-8edd-7d6329dd6db2 Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'server_id': '81845d9a-a800-4e7a-8edd-7d6329dd6db2', 'body': {'volumeAttachment': {'volumeId': '09f7a1e7-507f-4643-a1c2-03445acdd09f'}}} Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 09f7a1e7-507f-4643-a1c2-03445acdd09f is already attached to instances: 81845d9a-a800-4e7a-8edd-7d6329dd6db2 Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:16:39.214775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 09f7a1e7-507f-4643-a1c2-03445acdd09f is already attached to instances: 81845d9a-a800-4e7a-8edd-7d6329dd6db2 Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:39.216054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:39.217482 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:39.217482 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:16:39.217482 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:16:39.217482 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 09f7a1e7-507f-4643-a1c2-03445acdd09f is already attached to instances: 81845d9a-a800-4e7a-8edd-7d6329dd6db2 Aug 30 01:16:39.217482 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:16:39.217482 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-8d58fdeb-043b-4098-8c2c-fd45425505fc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Returning 400 to user: Invalid volume: volume 09f7a1e7-507f-4643-a1c2-03445acdd09f is already attached to instances: 81845d9a-a800-4e7a-8edd-7d6329dd6db2 {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:16:39.217482 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-8d58fdeb-043b-4098-8c2c-fd45425505fc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "POST /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102905 Aug 30 01:16:39.217482 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 434/831] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 30 01:16:39 2022] POST /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:16:39.280596 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dce2f708-956b-439d-9461-681c77ae0dd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:39.281088 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dce2f708-956b-439d-9461-681c77ae0dd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:39.287064 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dce2f708-956b-439d-9461-681c77ae0dd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:39.287542 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dce2f708-956b-439d-9461-681c77ae0dd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:39.292050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dce2f708-956b-439d-9461-681c77ae0dd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:39.292050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dce2f708-956b-439d-9461-681c77ae0dd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:39.292050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dce2f708-956b-439d-9461-681c77ae0dd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:39.292050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dce2f708-956b-439d-9461-681c77ae0dd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:39.374821 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-dce2f708-956b-439d-9461-681c77ae0dd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lazy-loading 'services' on Instance uuid 81845d9a-a800-4e7a-8edd-7d6329dd6db2 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:16:39.599043 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dce2f708-956b-439d-9461-681c77ae0dd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/os-volume_attachments/09f7a1e7-507f-4643-a1c2-03445acdd09f" status: 202 len: 0 microversion: 2.1 time: 0.323053 Aug 30 01:16:39.599774 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 398/832] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 30 01:16:39 2022] DELETE /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/os-volume_attachments/09f7a1e7-507f-4643-a1c2-03445acdd09f => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:16:39.609025 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-943563d8-8f5c-412c-926d-2f791247e5b2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:39.612382 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-943563d8-8f5c-412c-926d-2f791247e5b2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:39.617634 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-943563d8-8f5c-412c-926d-2f791247e5b2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:39.618363 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-943563d8-8f5c-412c-926d-2f791247e5b2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:39.618801 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-943563d8-8f5c-412c-926d-2f791247e5b2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:39.619646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-943563d8-8f5c-412c-926d-2f791247e5b2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:39.620102 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-943563d8-8f5c-412c-926d-2f791247e5b2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:39.620500 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5f609a2b-cf3f-49eb-9509-c59b01c0748a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:39.620620 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-943563d8-8f5c-412c-926d-2f791247e5b2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:39.621235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5f609a2b-cf3f-49eb-9509-c59b01c0748a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] [instance: e1388d14-c15e-4f95-9b68-944001f0d53a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:39.628096 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f609a2b-cf3f-49eb-9509-c59b01c0748a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:39.628588 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f609a2b-cf3f-49eb-9509-c59b01c0748a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:39.629021 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f609a2b-cf3f-49eb-9509-c59b01c0748a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:39.629778 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f609a2b-cf3f-49eb-9509-c59b01c0748a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:39.630223 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f609a2b-cf3f-49eb-9509-c59b01c0748a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:39.630647 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f609a2b-cf3f-49eb-9509-c59b01c0748a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:39.645318 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-5f609a2b-cf3f-49eb-9509-c59b01c0748a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] HTTP exception thrown: Instance e1388d14-c15e-4f95-9b68-944001f0d53a could not be found. Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5f609a2b-cf3f-49eb-9509-c59b01c0748a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Request method failure captured: Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a HTTP/1.1 Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWOeQEJvJe1oPgcAM0CJuHJZAsxaDOqgO7QH27qraPSKUTsAC4XPuYjUu6EVHrur_xArtWyqCb5JWbnssK7EJqykgUjLDeCSyIoPGge8kiHjsHWrlFHhD6AcbhjW0-wlasX1OPO3NkTkkmdkpMoIb_wVF9xmCsbss_a5nytHoL3C3Tw Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 9f0605a8a2fe48e49a410127b5f3b32c Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1432841125 Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:16:39.647092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:16:39.648730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f0605a8a2fe48e49a410127b5f3b32c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:16:39.648730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1432841125 Aug 30 01:16:39.648730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 9f0605a8a2fe48e49a410127b5f3b32c Aug 30 01:16:39.648730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1432841125 Aug 30 01:16:39.648730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-ServerRescueNegativeTestJSON-1432841125-project Aug 30 01:16:39.648730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:16:39.648730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:16:39.648730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 76ea3ed3bb2b412093004c7e0f49c7ce Aug 30 01:16:39.648730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1432841125-project Aug 30 01:16:39.648730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:16:39.648730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance e1388d14-c15e-4f95-9b68-944001f0d53a could not be found. Aug 30 01:16:39.648730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': 'e1388d14-c15e-4f95-9b68-944001f0d53a'} Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1388d14-c15e-4f95-9b68-944001f0d53a could not be found. Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:16:39.649875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1388d14-c15e-4f95-9b68-944001f0d53a could not be found. Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1388d14-c15e-4f95-9b68-944001f0d53a could not be found. Aug 30 01:16:39.651178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:16:39.652283 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5f609a2b-cf3f-49eb-9509-c59b01c0748a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] Returning 404 to user: Instance e1388d14-c15e-4f95-9b68-944001f0d53a could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:16:39.652283 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5f609a2b-cf3f-49eb-9509-c59b01c0748a tempest-ServerRescueNegativeTestJSON-1432841125 tempest-ServerRescueNegativeTestJSON-1432841125-project] 10.222.0.52 "GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a" status: 404 len: 111 microversion: 2.1 time: 0.032532 Aug 30 01:16:39.652283 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 399/833] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:39 2022] GET /compute/v2.1/servers/e1388d14-c15e-4f95-9b68-944001f0d53a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:16:39.658410 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-943563d8-8f5c-412c-926d-2f791247e5b2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054044 Aug 30 01:16:39.659057 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 435/834] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:16:39 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:40.672518 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2a1e11ae-145d-41d9-889f-b7957fa281f2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:40.675092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2a1e11ae-145d-41d9-889f-b7957fa281f2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:40.681650 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a1e11ae-145d-41d9-889f-b7957fa281f2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:40.682170 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a1e11ae-145d-41d9-889f-b7957fa281f2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:40.682603 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a1e11ae-145d-41d9-889f-b7957fa281f2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:40.683305 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a1e11ae-145d-41d9-889f-b7957fa281f2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:40.683757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a1e11ae-145d-41d9-889f-b7957fa281f2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:40.684185 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a1e11ae-145d-41d9-889f-b7957fa281f2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:40.711719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:40.716708 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2a1e11ae-145d-41d9-889f-b7957fa281f2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049513 Aug 30 01:16:40.721012 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 400/835] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:16:40 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:41.728811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0b6dee79-0b48-428f-860c-dcf33441479d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:41.730990 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0b6dee79-0b48-428f-860c-dcf33441479d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:41.737829 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b6dee79-0b48-428f-860c-dcf33441479d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:41.738313 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b6dee79-0b48-428f-860c-dcf33441479d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:41.738969 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b6dee79-0b48-428f-860c-dcf33441479d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:41.739672 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b6dee79-0b48-428f-860c-dcf33441479d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:41.740301 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b6dee79-0b48-428f-860c-dcf33441479d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:41.740730 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b6dee79-0b48-428f-860c-dcf33441479d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:41.773446 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0b6dee79-0b48-428f-860c-dcf33441479d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048601 Aug 30 01:16:41.774285 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 436/836] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:16:41 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:16:41.842691 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ce9ad240-6b8d-4fa1-a830-5d2d9559f28f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:41.843773 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ce9ad240-6b8d-4fa1-a830-5d2d9559f28f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:41.852545 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce9ad240-6b8d-4fa1-a830-5d2d9559f28f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:41.853302 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce9ad240-6b8d-4fa1-a830-5d2d9559f28f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:41.853944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce9ad240-6b8d-4fa1-a830-5d2d9559f28f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:41.854870 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce9ad240-6b8d-4fa1-a830-5d2d9559f28f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:41.855475 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce9ad240-6b8d-4fa1-a830-5d2d9559f28f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:41.856067 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce9ad240-6b8d-4fa1-a830-5d2d9559f28f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:41.883270 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ce9ad240-6b8d-4fa1-a830-5d2d9559f28f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:16:42.183202 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ce9ad240-6b8d-4fa1-a830-5d2d9559f28f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 204 len: 0 microversion: 2.1 time: 0.343777 Aug 30 01:16:42.184248 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 401/837] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:16:41 2022] DELETE /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:16:42.195104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d15df688-5257-4886-a827-ba56a6a4abc8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:42.195993 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d15df688-5257-4886-a827-ba56a6a4abc8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:42.202543 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d15df688-5257-4886-a827-ba56a6a4abc8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:42.202966 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d15df688-5257-4886-a827-ba56a6a4abc8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:42.203402 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d15df688-5257-4886-a827-ba56a6a4abc8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:42.204109 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d15df688-5257-4886-a827-ba56a6a4abc8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:42.204591 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d15df688-5257-4886-a827-ba56a6a4abc8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:42.205025 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d15df688-5257-4886-a827-ba56a6a4abc8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:42.358470 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d15df688-5257-4886-a827-ba56a6a4abc8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:42.368573 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d15df688-5257-4886-a827-ba56a6a4abc8 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1681 microversion: 2.1 time: 0.177619 Aug 30 01:16:42.370781 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 437/838] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:42 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:43.145441 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e7664452-d97c-430c-aa23-19f5237f63af tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:43.150305 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e7664452-d97c-430c-aa23-19f5237f63af tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:43.154962 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7664452-d97c-430c-aa23-19f5237f63af tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:43.155733 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7664452-d97c-430c-aa23-19f5237f63af tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:43.156300 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7664452-d97c-430c-aa23-19f5237f63af tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:43.157014 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7664452-d97c-430c-aa23-19f5237f63af tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:43.157473 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7664452-d97c-430c-aa23-19f5237f63af tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:43.157921 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7664452-d97c-430c-aa23-19f5237f63af tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:43.400022 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-7a8a3806-3536-4f9e-b794-0fa495b41b93 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:43.401133 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-7a8a3806-3536-4f9e-b794-0fa495b41b93 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:43.414091 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7a8a3806-3536-4f9e-b794-0fa495b41b93 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:43.414587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7a8a3806-3536-4f9e-b794-0fa495b41b93 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:43.415022 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7a8a3806-3536-4f9e-b794-0fa495b41b93 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:43.416038 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7a8a3806-3536-4f9e-b794-0fa495b41b93 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:43.418665 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e7664452-d97c-430c-aa23-19f5237f63af tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "POST /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/action" status: 202 len: 0 microversion: 2.1 time: 0.277292 Aug 30 01:16:43.426512 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 402/839] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 30 01:16:43 2022] POST /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:16:43.426811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7a8a3806-3536-4f9e-b794-0fa495b41b93 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:43.426811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7a8a3806-3536-4f9e-b794-0fa495b41b93 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:43.428563 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4f0d2807-9e7a-4b4d-ae51-cedff7048542 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:43.429338 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4f0d2807-9e7a-4b4d-ae51-cedff7048542 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:43.439617 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f0d2807-9e7a-4b4d-ae51-cedff7048542 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:43.440200 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f0d2807-9e7a-4b4d-ae51-cedff7048542 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:43.440718 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f0d2807-9e7a-4b4d-ae51-cedff7048542 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:43.441595 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f0d2807-9e7a-4b4d-ae51-cedff7048542 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:43.442194 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f0d2807-9e7a-4b4d-ae51-cedff7048542 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:43.442695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f0d2807-9e7a-4b4d-ae51-cedff7048542 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:43.584599 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7a8a3806-3536-4f9e-b794-0fa495b41b93 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:43.594991 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-7a8a3806-3536-4f9e-b794-0fa495b41b93 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1681 microversion: 2.1 time: 0.207713 Aug 30 01:16:43.606458 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 438/840] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:43 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:43.627645 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4f0d2807-9e7a-4b4d-ae51-cedff7048542 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:43.636205 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4f0d2807-9e7a-4b4d-ae51-cedff7048542 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1750 microversion: 2.1 time: 0.211957 Aug 30 01:16:43.636774 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 403/841] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:43 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1750 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:44.620161 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d57a360c-7e8e-445c-8783-c0dcd277dbcf tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:44.621080 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d57a360c-7e8e-445c-8783-c0dcd277dbcf tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:44.628206 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d57a360c-7e8e-445c-8783-c0dcd277dbcf tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:44.628785 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d57a360c-7e8e-445c-8783-c0dcd277dbcf tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:44.629429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d57a360c-7e8e-445c-8783-c0dcd277dbcf tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:44.630361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d57a360c-7e8e-445c-8783-c0dcd277dbcf tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:44.630839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d57a360c-7e8e-445c-8783-c0dcd277dbcf tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:44.631272 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d57a360c-7e8e-445c-8783-c0dcd277dbcf tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:44.659824 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1afc40c3-d2cc-436f-8939-a4343f4158e4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:44.661320 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1afc40c3-d2cc-436f-8939-a4343f4158e4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:44.673331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1afc40c3-d2cc-436f-8939-a4343f4158e4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:44.676298 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1afc40c3-d2cc-436f-8939-a4343f4158e4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:44.676974 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1afc40c3-d2cc-436f-8939-a4343f4158e4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:44.677961 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1afc40c3-d2cc-436f-8939-a4343f4158e4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:44.680797 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1afc40c3-d2cc-436f-8939-a4343f4158e4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:44.681668 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1afc40c3-d2cc-436f-8939-a4343f4158e4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:44.825448 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d57a360c-7e8e-445c-8783-c0dcd277dbcf tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:44.831999 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d57a360c-7e8e-445c-8783-c0dcd277dbcf tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1681 microversion: 2.1 time: 0.216523 Aug 30 01:16:44.832699 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 439/842] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:44 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:45.368095 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1afc40c3-d2cc-436f-8939-a4343f4158e4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:45.378332 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1afc40c3-d2cc-436f-8939-a4343f4158e4 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1750 microversion: 2.1 time: 0.722364 Aug 30 01:16:45.379036 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 404/843] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:44 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1750 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:45.859054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4f57dcad-c241-4f09-ad19-37d77ca1de83 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:45.859778 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4f57dcad-c241-4f09-ad19-37d77ca1de83 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:45.874940 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f57dcad-c241-4f09-ad19-37d77ca1de83 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:45.875436 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f57dcad-c241-4f09-ad19-37d77ca1de83 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:45.877913 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f57dcad-c241-4f09-ad19-37d77ca1de83 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:45.878882 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f57dcad-c241-4f09-ad19-37d77ca1de83 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:45.879350 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f57dcad-c241-4f09-ad19-37d77ca1de83 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:45.879785 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f57dcad-c241-4f09-ad19-37d77ca1de83 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:45.964064 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4f57dcad-c241-4f09-ad19-37d77ca1de83 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:45.984745 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4f57dcad-c241-4f09-ad19-37d77ca1de83 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1614 microversion: 2.1 time: 0.128350 Aug 30 01:16:45.984745 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 440/844] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:45 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1614 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:46.026855 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-0dda2b9f-d6b6-44e8-9b3b-6b9fb310f8e5 req-751d5a15-f5ac-432d-b636-b311f9456c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81845d9a-a800-4e7a-8edd-7d6329dd6db2", "name": "network-vif-deleted", "tag": "ebd82af4-7bf6-4f28-91c9-b9f6fc86225c"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:46.034559 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:46.038684 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-0dda2b9f-d6b6-44e8-9b3b-6b9fb310f8e5 req-751d5a15-f5ac-432d-b636-b311f9456c57 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:46.039165 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-0dda2b9f-d6b6-44e8-9b3b-6b9fb310f8e5 req-751d5a15-f5ac-432d-b636-b311f9456c57 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:46.039601 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-0dda2b9f-d6b6-44e8-9b3b-6b9fb310f8e5 req-751d5a15-f5ac-432d-b636-b311f9456c57 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:46.056102 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-0dda2b9f-d6b6-44e8-9b3b-6b9fb310f8e5 req-751d5a15-f5ac-432d-b636-b311f9456c57 service nova] Creating event network-vif-deleted:ebd82af4-7bf6-4f28-91c9-b9f6fc86225c for instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 on hv-cinder-81571 Aug 30 01:16:46.063941 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-0dda2b9f-d6b6-44e8-9b3b-6b9fb310f8e5 req-751d5a15-f5ac-432d-b636-b311f9456c57 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040994 Aug 30 01:16:46.065665 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 405/845] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:46.400300 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ca13936a-2c17-4668-81a9-4eba3e005356 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:46.401219 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ca13936a-2c17-4668-81a9-4eba3e005356 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:46.403230 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:46.408350 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ca13936a-2c17-4668-81a9-4eba3e005356 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:46.408851 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ca13936a-2c17-4668-81a9-4eba3e005356 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:46.409314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ca13936a-2c17-4668-81a9-4eba3e005356 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:46.410056 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ca13936a-2c17-4668-81a9-4eba3e005356 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:46.410509 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ca13936a-2c17-4668-81a9-4eba3e005356 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:46.411135 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ca13936a-2c17-4668-81a9-4eba3e005356 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:46.583630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ca13936a-2c17-4668-81a9-4eba3e005356 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:46.594325 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ca13936a-2c17-4668-81a9-4eba3e005356 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1755 microversion: 2.1 time: 0.197776 Aug 30 01:16:46.595066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 441/846] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:46 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1755 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:47.009001 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0c49a6bc-f646-4877-9125-24a9d066aa87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:47.009789 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0c49a6bc-f646-4877-9125-24a9d066aa87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:47.016725 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c49a6bc-f646-4877-9125-24a9d066aa87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:47.017209 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c49a6bc-f646-4877-9125-24a9d066aa87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:47.017665 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c49a6bc-f646-4877-9125-24a9d066aa87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:47.018426 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c49a6bc-f646-4877-9125-24a9d066aa87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:47.018885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c49a6bc-f646-4877-9125-24a9d066aa87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:47.019312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c49a6bc-f646-4877-9125-24a9d066aa87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:47.054693 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c49a6bc-f646-4877-9125-24a9d066aa87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:47.055349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c49a6bc-f646-4877-9125-24a9d066aa87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:47.055619 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c49a6bc-f646-4877-9125-24a9d066aa87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:47.056075 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-0c49a6bc-f646-4877-9125-24a9d066aa87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lazy-loading 'fault' on Instance uuid 81845d9a-a800-4e7a-8edd-7d6329dd6db2 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:16:47.099600 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0c49a6bc-f646-4877-9125-24a9d066aa87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:47.108306 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0c49a6bc-f646-4877-9125-24a9d066aa87 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 200 len: 1331 microversion: 2.1 time: 0.104002 Aug 30 01:16:47.108894 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 406/847] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:47 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:47.621830 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-92075144-4104-42ce-ae0a-7df861f0cad1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:47.624097 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-92075144-4104-42ce-ae0a-7df861f0cad1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:47.630667 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-92075144-4104-42ce-ae0a-7df861f0cad1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:47.631446 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-92075144-4104-42ce-ae0a-7df861f0cad1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:47.631892 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-92075144-4104-42ce-ae0a-7df861f0cad1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:47.632598 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-92075144-4104-42ce-ae0a-7df861f0cad1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:47.633531 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-92075144-4104-42ce-ae0a-7df861f0cad1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:47.634106 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-92075144-4104-42ce-ae0a-7df861f0cad1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:47.787293 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-92075144-4104-42ce-ae0a-7df861f0cad1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:47.796539 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-92075144-4104-42ce-ae0a-7df861f0cad1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1755 microversion: 2.1 time: 0.179766 Aug 30 01:16:47.797111 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 442/848] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:47 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:48.153799 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4cbfd34b-1e16-4b2f-8dc0-37f75ffdc149 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:48.154608 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4cbfd34b-1e16-4b2f-8dc0-37f75ffdc149 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:48.161667 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4cbfd34b-1e16-4b2f-8dc0-37f75ffdc149 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:48.162195 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4cbfd34b-1e16-4b2f-8dc0-37f75ffdc149 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:48.162629 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4cbfd34b-1e16-4b2f-8dc0-37f75ffdc149 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:48.163325 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4cbfd34b-1e16-4b2f-8dc0-37f75ffdc149 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:48.163780 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4cbfd34b-1e16-4b2f-8dc0-37f75ffdc149 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:48.164203 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4cbfd34b-1e16-4b2f-8dc0-37f75ffdc149 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:48.178981 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-4cbfd34b-1e16-4b2f-8dc0-37f75ffdc149 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] HTTP exception thrown: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4cbfd34b-1e16-4b2f-8dc0-37f75ffdc149 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Request method failure captured: Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 HTTP/1.1 Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWOflXbDFJWgbl1TJC3Oy148qXhrnxQzWwozAEpLPUvBjkIue1CYn_oh9imGJ1y-bHs91DQfacqzNdoPNGJGBFUNkjPdHbXnb83IH3jbui9qUN0KpZ__R_CPwPnS8jDFUUiZ7g8Gk1RFVQFkhvoh-4PF9zh2BgfTwME3tmMd22zrKs0 Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:16:48.180183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:16:48.181804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:16:48.181804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:16:48.181804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:16:48.181804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:16:48.181804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:16:48.181804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:16:48.181804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:16:48.181804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 942d175e7e2742728e66fea84c851038 Aug 30 01:16:48.181804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:16:48.181804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:16:48.181804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. Aug 30 01:16:48.181804 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': '81845d9a-a800-4e7a-8edd-7d6329dd6db2'} Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:16:48.182927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. Aug 30 01:16:48.184440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:16:48.186473 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4cbfd34b-1e16-4b2f-8dc0-37f75ffdc149 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Returning 404 to user: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:16:48.186473 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4cbfd34b-1e16-4b2f-8dc0-37f75ffdc149 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 404 len: 111 microversion: 2.1 time: 0.032038 Aug 30 01:16:48.186473 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 407/849] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:48 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:16:48.191286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-11dcdb55-cf15-4385-a622-ae6f1fc6b84d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '.version_select at 0x7fd71ce42af0>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:48.264952 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-11dcdb55-cf15-4385-a622-ae6f1fc6b84d tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712190695" status: 202 len: 0 microversion: 2.1 time: 0.077171 Aug 30 01:16:48.265580 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 443/850] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Aug 30 01:16:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712190695 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:16:48.817676 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2533811a-28ae-4680-8e66-f4b68bc1ae21 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:48.818322 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2533811a-28ae-4680-8e66-f4b68bc1ae21 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:48.824522 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2533811a-28ae-4680-8e66-f4b68bc1ae21 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:48.825013 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2533811a-28ae-4680-8e66-f4b68bc1ae21 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:48.825473 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2533811a-28ae-4680-8e66-f4b68bc1ae21 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:48.826760 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2533811a-28ae-4680-8e66-f4b68bc1ae21 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:48.827219 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2533811a-28ae-4680-8e66-f4b68bc1ae21 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:48.827650 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2533811a-28ae-4680-8e66-f4b68bc1ae21 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:48.995636 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2533811a-28ae-4680-8e66-f4b68bc1ae21 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:49.006819 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2533811a-28ae-4680-8e66-f4b68bc1ae21 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1755 microversion: 2.1 time: 0.190756 Aug 30 01:16:49.006819 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 408/851] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:48 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:49.146207 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c01a6437-755b-42ff-bb4d-baf2301b3fec tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Action: 'create', calling method: .version_select at 0x7fd71cec14c0>, body: {"keypair": {"name": "tempest-keypair-2126149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNopyuOGJ5LHhk3DiLkWC1czn0V5hy1TXknf3wiG70vFvAodyXOcCA8H+42RzMp8kzjg37IcgOrXvrxdF7xy9ZOj9sJXCt31zfyNM1E/opcFWVC2N5k5oIWdzEsWTdd1Fw=="}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:49.165396 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-c01a6437-755b-42ff-bb4d-baf2301b3fec tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Getting quotas for project 11c8f48af7394a75ab6013ca066751a7. Resources: {'key_pairs'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:16:49.170397 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-c01a6437-755b-42ff-bb4d-baf2301b3fec tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Getting quotas for user 942d175e7e2742728e66fea84c851038 and project 11c8f48af7394a75ab6013ca066751a7. Resources: {'key_pairs'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:16:49.299549 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c01a6437-755b-42ff-bb4d-baf2301b3fec tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.157940 Aug 30 01:16:49.300165 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 444/852] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 30 01:16:49 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:49.667147 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b6ac186a-2636-4ddd-89b8-562c3d2d261e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:49.667703 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b6ac186a-2636-4ddd-89b8-562c3d2d261e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:49.674470 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6ac186a-2636-4ddd-89b8-562c3d2d261e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:49.674952 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6ac186a-2636-4ddd-89b8-562c3d2d261e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:49.675385 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6ac186a-2636-4ddd-89b8-562c3d2d261e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:49.676073 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6ac186a-2636-4ddd-89b8-562c3d2d261e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:49.676520 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6ac186a-2636-4ddd-89b8-562c3d2d261e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:49.676938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6ac186a-2636-4ddd-89b8-562c3d2d261e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:49.701571 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b6ac186a-2636-4ddd-89b8-562c3d2d261e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d/ips" status: 200 len: 150 microversion: 2.20 time: 0.038023 Aug 30 01:16:49.702197 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 409/853] 10.222.0.52 () {60 vars in 1289 bytes} [Tue Aug 30 01:16:49 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:16:50.026288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ad72c49f-57ef-4674-aee0-0b329b45f8e1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:50.027298 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ad72c49f-57ef-4674-aee0-0b329b45f8e1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:50.034868 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ad72c49f-57ef-4674-aee0-0b329b45f8e1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:50.035232 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ad72c49f-57ef-4674-aee0-0b329b45f8e1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:50.035779 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ad72c49f-57ef-4674-aee0-0b329b45f8e1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:50.036821 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ad72c49f-57ef-4674-aee0-0b329b45f8e1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:50.037172 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ad72c49f-57ef-4674-aee0-0b329b45f8e1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:50.037894 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ad72c49f-57ef-4674-aee0-0b329b45f8e1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:50.229440 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ad72c49f-57ef-4674-aee0-0b329b45f8e1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:50.242787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ad72c49f-57ef-4674-aee0-0b329b45f8e1 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1755 microversion: 2.1 time: 0.221021 Aug 30 01:16:50.243381 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 445/854] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:50 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1755 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:16:51.276595 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ba0872ea-7398-47e0-ad65-0fb7aaf1fe9d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:51.277294 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ba0872ea-7398-47e0-ad65-0fb7aaf1fe9d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:51.286390 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba0872ea-7398-47e0-ad65-0fb7aaf1fe9d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:51.287103 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba0872ea-7398-47e0-ad65-0fb7aaf1fe9d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:51.287549 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba0872ea-7398-47e0-ad65-0fb7aaf1fe9d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:51.288263 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba0872ea-7398-47e0-ad65-0fb7aaf1fe9d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:51.288723 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba0872ea-7398-47e0-ad65-0fb7aaf1fe9d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:51.289198 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba0872ea-7398-47e0-ad65-0fb7aaf1fe9d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:51.445557 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ba0872ea-7398-47e0-ad65-0fb7aaf1fe9d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:51.454769 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ba0872ea-7398-47e0-ad65-0fb7aaf1fe9d tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1755 microversion: 2.1 time: 0.183386 Aug 30 01:16:51.455436 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 410/855] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:51 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:51.553206 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2160dfba-a053-4ad3-8692-1841d17a8ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:51.553810 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2160dfba-a053-4ad3-8692-1841d17a8ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:51.560906 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2160dfba-a053-4ad3-8692-1841d17a8ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:51.561418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2160dfba-a053-4ad3-8692-1841d17a8ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:51.561868 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2160dfba-a053-4ad3-8692-1841d17a8ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:51.562755 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2160dfba-a053-4ad3-8692-1841d17a8ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:51.563212 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2160dfba-a053-4ad3-8692-1841d17a8ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:51.563632 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2160dfba-a053-4ad3-8692-1841d17a8ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:51.587243 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2160dfba-a053-4ad3-8692-1841d17a8ca5 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/ips" status: 200 len: 146 microversion: 2.1 time: 0.037934 Aug 30 01:16:51.587811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 446/856] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 30 01:16:51 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:51.705412 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1324858655", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "281ceb28-999a-45ac-8b94-e3a5aba703ca"}], "security_groups": [{"name": "tempest-securitygroup--1497440308"}], "key_name": "tempest-keypair-2126149", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:51.815553 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] validate_networks() for [('281ceb28-999a-45ac-8b94-e3a5aba703ca', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:16:52.022744 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-bc2fd82e-764d-4cf1-baba-4f1c8f8be2b2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:52.023493 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-bc2fd82e-764d-4cf1-baba-4f1c8f8be2b2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:52.030378 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc2fd82e-764d-4cf1-baba-4f1c8f8be2b2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:52.030927 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc2fd82e-764d-4cf1-baba-4f1c8f8be2b2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:52.031368 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc2fd82e-764d-4cf1-baba-4f1c8f8be2b2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:52.032068 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc2fd82e-764d-4cf1-baba-4f1c8f8be2b2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:52.032544 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc2fd82e-764d-4cf1-baba-4f1c8f8be2b2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:52.032950 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bc2fd82e-764d-4cf1-baba-4f1c8f8be2b2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:52.056912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-bc2fd82e-764d-4cf1-baba-4f1c8f8be2b2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lazy-loading 'flavor' on Instance uuid 65b743eb-1b3f-458d-ad48-d60c3934ba0d {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:16:52.256844 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:52.350097 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:16:52.350097 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:16:52.350097 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:16:52.350097 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:16:52.350097 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:16:52.360344 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:52.360845 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:52.361765 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:52.363186 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:52.363912 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:52.364348 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:52.390268 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Getting quotas for project 11c8f48af7394a75ab6013ca066751a7. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:16:52.390803 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Getting quotas for user 942d175e7e2742728e66fea84c851038 and project 11c8f48af7394a75ab6013ca066751a7. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:16:52.402559 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:16:52.405096 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:16:52.578761 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-06d677c4-4674-4619-b4f5-ede2fd08c6bc tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.878454 Aug 30 01:16:52.585575 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 411/857] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:16:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 01:16:52.585780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-bc2fd82e-764d-4cf1-baba-4f1c8f8be2b2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "POST /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d/action" status: 202 len: 0 microversion: 2.20 time: 0.561954 Aug 30 01:16:52.585780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 447/858] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Aug 30 01:16:52 2022] POST /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 01:16:52.588985 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-31b34a30-2421-4ed0-87fa-0e53c256bfe0 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:52.589608 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-31b34a30-2421-4ed0-87fa-0e53c256bfe0 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:52.590446 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0b4b6915-8366-4895-9124-1450bb9c2de0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:52.591142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0b4b6915-8366-4895-9124-1450bb9c2de0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:52.598378 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31b34a30-2421-4ed0-87fa-0e53c256bfe0 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:52.599208 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31b34a30-2421-4ed0-87fa-0e53c256bfe0 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:52.599649 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31b34a30-2421-4ed0-87fa-0e53c256bfe0 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:52.600004 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b4b6915-8366-4895-9124-1450bb9c2de0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:52.600412 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31b34a30-2421-4ed0-87fa-0e53c256bfe0 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:52.601085 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31b34a30-2421-4ed0-87fa-0e53c256bfe0 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:52.601168 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b4b6915-8366-4895-9124-1450bb9c2de0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:52.601476 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31b34a30-2421-4ed0-87fa-0e53c256bfe0 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:52.601571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b4b6915-8366-4895-9124-1450bb9c2de0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:52.602381 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b4b6915-8366-4895-9124-1450bb9c2de0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:52.602791 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b4b6915-8366-4895-9124-1450bb9c2de0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:52.603320 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b4b6915-8366-4895-9124-1450bb9c2de0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:52.784369 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0b4b6915-8366-4895-9124-1450bb9c2de0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:52.786019 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-31b34a30-2421-4ed0-87fa-0e53c256bfe0 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:52.793662 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0b4b6915-8366-4895-9124-1450bb9c2de0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:52.795407 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-31b34a30-2421-4ed0-87fa-0e53c256bfe0 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1755 microversion: 2.1 time: 0.214639 Aug 30 01:16:52.795651 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0b4b6915-8366-4895-9124-1450bb9c2de0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:52.796218 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 412/859] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:52 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1755 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:52.800829 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4563958e-0a1e-411c-a156-da7de609213b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:52.801435 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4563958e-0a1e-411c-a156-da7de609213b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:52.810617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0b4b6915-8366-4895-9124-1450bb9c2de0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.224311 Aug 30 01:16:52.811585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 448/860] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:16:52 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:16:52.858513 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4563958e-0a1e-411c-a156-da7de609213b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:52.866622 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4563958e-0a1e-411c-a156-da7de609213b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1239 microversion: 2.1 time: 0.068968 Aug 30 01:16:52.870208 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 413/861] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:52 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:53.817031 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e6e8c0fb-2221-48fd-b4b5-5ab44f6558a6 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:53.817639 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e6e8c0fb-2221-48fd-b4b5-5ab44f6558a6 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:53.824212 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e6e8c0fb-2221-48fd-b4b5-5ab44f6558a6 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:53.824694 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e6e8c0fb-2221-48fd-b4b5-5ab44f6558a6 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:53.825131 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e6e8c0fb-2221-48fd-b4b5-5ab44f6558a6 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:53.826430 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e6e8c0fb-2221-48fd-b4b5-5ab44f6558a6 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:53.826888 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e6e8c0fb-2221-48fd-b4b5-5ab44f6558a6 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:53.827309 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e6e8c0fb-2221-48fd-b4b5-5ab44f6558a6 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:53.834287 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-afb1a70a-7161-4ae8-b974-38f6f2ba5407 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:53.835018 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-afb1a70a-7161-4ae8-b974-38f6f2ba5407 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:53.841763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afb1a70a-7161-4ae8-b974-38f6f2ba5407 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:53.842363 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afb1a70a-7161-4ae8-b974-38f6f2ba5407 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:53.842830 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afb1a70a-7161-4ae8-b974-38f6f2ba5407 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:53.843541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afb1a70a-7161-4ae8-b974-38f6f2ba5407 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:53.843999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afb1a70a-7161-4ae8-b974-38f6f2ba5407 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:53.844427 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afb1a70a-7161-4ae8-b974-38f6f2ba5407 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:53.970765 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e6e8c0fb-2221-48fd-b4b5-5ab44f6558a6 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:53.979669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e6e8c0fb-2221-48fd-b4b5-5ab44f6558a6 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1755 microversion: 2.1 time: 0.166409 Aug 30 01:16:53.980253 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 449/862] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:53 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:53.983158 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-afb1a70a-7161-4ae8-b974-38f6f2ba5407 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:53.985290 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e50ce57e-d1ab-48d2-b170-a139bb2467b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:53.985938 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e50ce57e-d1ab-48d2-b170-a139bb2467b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:53.991837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-afb1a70a-7161-4ae8-b974-38f6f2ba5407 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:53.992009 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e50ce57e-d1ab-48d2-b170-a139bb2467b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:53.992473 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e50ce57e-d1ab-48d2-b170-a139bb2467b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:53.992902 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e50ce57e-d1ab-48d2-b170-a139bb2467b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:53.993290 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-afb1a70a-7161-4ae8-b974-38f6f2ba5407 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:53.993598 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e50ce57e-d1ab-48d2-b170-a139bb2467b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:53.994085 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e50ce57e-d1ab-48d2-b170-a139bb2467b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:53.994486 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-afb1a70a-7161-4ae8-b974-38f6f2ba5407 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.164082 Aug 30 01:16:53.994600 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e50ce57e-d1ab-48d2-b170-a139bb2467b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:53.995054 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 414/863] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:16:53 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:16:54.056637 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e50ce57e-d1ab-48d2-b170-a139bb2467b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:54.065413 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e50ce57e-d1ab-48d2-b170-a139bb2467b7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1243 microversion: 2.1 time: 0.084174 Aug 30 01:16:54.066026 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 450/864] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:53 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1243 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:55.002404 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b3d0eace-fece-47eb-b97b-680d1292c1df tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:55.003020 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b3d0eace-fece-47eb-b97b-680d1292c1df tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:55.009453 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3d0eace-fece-47eb-b97b-680d1292c1df tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:55.009996 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3d0eace-fece-47eb-b97b-680d1292c1df tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:55.010435 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3d0eace-fece-47eb-b97b-680d1292c1df tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:55.011129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3d0eace-fece-47eb-b97b-680d1292c1df tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:55.011615 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3d0eace-fece-47eb-b97b-680d1292c1df tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:55.012042 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3d0eace-fece-47eb-b97b-680d1292c1df tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:55.018993 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d62ed39e-f7a5-4d7b-a44f-da7d46d067cf tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:55.033586 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d62ed39e-f7a5-4d7b-a44f-da7d46d067cf tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:55.033586 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d62ed39e-f7a5-4d7b-a44f-da7d46d067cf tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:55.033586 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d62ed39e-f7a5-4d7b-a44f-da7d46d067cf tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:55.033586 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d62ed39e-f7a5-4d7b-a44f-da7d46d067cf tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:55.034220 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d62ed39e-f7a5-4d7b-a44f-da7d46d067cf tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:55.034220 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d62ed39e-f7a5-4d7b-a44f-da7d46d067cf tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:55.034220 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d62ed39e-f7a5-4d7b-a44f-da7d46d067cf tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:55.163544 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b3d0eace-fece-47eb-b97b-680d1292c1df tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:55.173196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b3d0eace-fece-47eb-b97b-680d1292c1df tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1755 microversion: 2.1 time: 0.174454 Aug 30 01:16:55.178989 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 415/865] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:54 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:55.188949 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e09fc0cf-08f2-4cf4-aba5-6f65a6b30173 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:55.188949 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e09fc0cf-08f2-4cf4-aba5-6f65a6b30173 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:55.188949 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e09fc0cf-08f2-4cf4-aba5-6f65a6b30173 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:55.188949 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e09fc0cf-08f2-4cf4-aba5-6f65a6b30173 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:55.189513 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e09fc0cf-08f2-4cf4-aba5-6f65a6b30173 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:55.189513 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e09fc0cf-08f2-4cf4-aba5-6f65a6b30173 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:55.189687 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d62ed39e-f7a5-4d7b-a44f-da7d46d067cf tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:55.189901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e09fc0cf-08f2-4cf4-aba5-6f65a6b30173 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:55.190224 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e09fc0cf-08f2-4cf4-aba5-6f65a6b30173 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:55.198802 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d62ed39e-f7a5-4d7b-a44f-da7d46d067cf tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:55.200242 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d62ed39e-f7a5-4d7b-a44f-da7d46d067cf tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:55.202123 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d62ed39e-f7a5-4d7b-a44f-da7d46d067cf tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.187451 Aug 30 01:16:55.202691 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 451/866] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:16:55 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:16:55.252300 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e09fc0cf-08f2-4cf4-aba5-6f65a6b30173 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:55.259996 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e09fc0cf-08f2-4cf4-aba5-6f65a6b30173 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1235 microversion: 2.1 time: 0.083756 Aug 30 01:16:55.260570 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 416/867] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:55 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1235 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:55.415698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a4e08f4b-4894-41ef-8001-90e1b31f9cca tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05f83d94-aac7-424a-befd-413bb102413d"}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:55.418704 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a4e08f4b-4894-41ef-8001-90e1b31f9cca tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:55.425791 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a4e08f4b-4894-41ef-8001-90e1b31f9cca tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:55.426292 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a4e08f4b-4894-41ef-8001-90e1b31f9cca tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:55.430327 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a4e08f4b-4894-41ef-8001-90e1b31f9cca tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:55.430327 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a4e08f4b-4894-41ef-8001-90e1b31f9cca tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:55.430327 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a4e08f4b-4894-41ef-8001-90e1b31f9cca tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:55.430327 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a4e08f4b-4894-41ef-8001-90e1b31f9cca tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:56.196409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a84913a8-6e5c-4d38-87e8-f03e193e841f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:56.197030 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a84913a8-6e5c-4d38-87e8-f03e193e841f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:56.203774 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a84913a8-6e5c-4d38-87e8-f03e193e841f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:56.204331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a84913a8-6e5c-4d38-87e8-f03e193e841f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:56.204777 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a84913a8-6e5c-4d38-87e8-f03e193e841f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:56.205488 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a84913a8-6e5c-4d38-87e8-f03e193e841f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:56.205998 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a84913a8-6e5c-4d38-87e8-f03e193e841f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:56.206429 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a84913a8-6e5c-4d38-87e8-f03e193e841f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:56.362682 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a84913a8-6e5c-4d38-87e8-f03e193e841f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:56.366207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:56.374453 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a84913a8-6e5c-4d38-87e8-f03e193e841f tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1755 microversion: 2.1 time: 0.181791 Aug 30 01:16:56.375228 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 417/868] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:56 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:16:56.380061 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a4e08f4b-4894-41ef-8001-90e1b31f9cca tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "POST /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.969357 Aug 30 01:16:56.380579 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1efafd47-125b-4508-8396-f634efe46136 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:56.381683 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 452/869] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 30 01:16:55 2022] POST /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments => generated 194 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:56.386977 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1efafd47-125b-4508-8396-f634efe46136 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:56.393692 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1efafd47-125b-4508-8396-f634efe46136 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:56.394233 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1efafd47-125b-4508-8396-f634efe46136 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:56.394699 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1efafd47-125b-4508-8396-f634efe46136 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:56.395418 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1efafd47-125b-4508-8396-f634efe46136 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:56.396077 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1efafd47-125b-4508-8396-f634efe46136 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:56.396544 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1efafd47-125b-4508-8396-f634efe46136 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:56.397600 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-10bb35df-2619-4311-8501-42070efa04cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:56.398757 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-10bb35df-2619-4311-8501-42070efa04cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:56.408220 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10bb35df-2619-4311-8501-42070efa04cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:56.408733 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10bb35df-2619-4311-8501-42070efa04cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:56.409295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10bb35df-2619-4311-8501-42070efa04cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:56.410127 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10bb35df-2619-4311-8501-42070efa04cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:56.410585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10bb35df-2619-4311-8501-42070efa04cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:56.411016 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-10bb35df-2619-4311-8501-42070efa04cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:56.496171 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-10bb35df-2619-4311-8501-42070efa04cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:56.505077 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-10bb35df-2619-4311-8501-42070efa04cb tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1291 microversion: 2.1 time: 0.122648 Aug 30 01:16:56.506053 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 453/870] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:56 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1291 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:56.620475 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1efafd47-125b-4508-8396-f634efe46136 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:56.630243 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1efafd47-125b-4508-8396-f634efe46136 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:56.631730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1efafd47-125b-4508-8396-f634efe46136 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:56.632904 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1efafd47-125b-4508-8396-f634efe46136 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.256579 Aug 30 01:16:56.633478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 418/871] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:16:56 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:16:57.400792 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d71d3efa-2bff-47ed-9c25-d38005bad4ee tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:57.412364 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d71d3efa-2bff-47ed-9c25-d38005bad4ee tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:57.412364 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d71d3efa-2bff-47ed-9c25-d38005bad4ee tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:57.412884 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d71d3efa-2bff-47ed-9c25-d38005bad4ee tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:57.413134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d71d3efa-2bff-47ed-9c25-d38005bad4ee tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:57.413910 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d71d3efa-2bff-47ed-9c25-d38005bad4ee tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:57.414408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d71d3efa-2bff-47ed-9c25-d38005bad4ee tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:57.414839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d71d3efa-2bff-47ed-9c25-d38005bad4ee tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:57.532149 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0e3bed3a-67c3-4d08-9384-661ffdee0f8c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:57.533312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0e3bed3a-67c3-4d08-9384-661ffdee0f8c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:57.542253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e3bed3a-67c3-4d08-9384-661ffdee0f8c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:57.543084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e3bed3a-67c3-4d08-9384-661ffdee0f8c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:57.543591 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e3bed3a-67c3-4d08-9384-661ffdee0f8c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:57.545012 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e3bed3a-67c3-4d08-9384-661ffdee0f8c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:57.545632 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e3bed3a-67c3-4d08-9384-661ffdee0f8c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:57.546006 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e3bed3a-67c3-4d08-9384-661ffdee0f8c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:57.603710 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d71d3efa-2bff-47ed-9c25-d38005bad4ee tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:57.612910 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d71d3efa-2bff-47ed-9c25-d38005bad4ee tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1755 microversion: 2.1 time: 0.216898 Aug 30 01:16:57.613498 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 454/872] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:57 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1755 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:57.657663 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-25896cc3-6f30-4796-a3bf-5d645ca3e9dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:57.658243 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-25896cc3-6f30-4796-a3bf-5d645ca3e9dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:57.666878 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25896cc3-6f30-4796-a3bf-5d645ca3e9dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:57.667770 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25896cc3-6f30-4796-a3bf-5d645ca3e9dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:57.668929 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25896cc3-6f30-4796-a3bf-5d645ca3e9dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:57.671096 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25896cc3-6f30-4796-a3bf-5d645ca3e9dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:57.680943 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25896cc3-6f30-4796-a3bf-5d645ca3e9dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:57.680943 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25896cc3-6f30-4796-a3bf-5d645ca3e9dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:57.785419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0e3bed3a-67c3-4d08-9384-661ffdee0f8c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:57.794891 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0e3bed3a-67c3-4d08-9384-661ffdee0f8c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1365 microversion: 2.1 time: 0.271809 Aug 30 01:16:57.795822 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 419/873] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:57 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:57.833282 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-25896cc3-6f30-4796-a3bf-5d645ca3e9dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:57.842728 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-25896cc3-6f30-4796-a3bf-5d645ca3e9dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:57.843791 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-25896cc3-6f30-4796-a3bf-5d645ca3e9dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:57.844975 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-25896cc3-6f30-4796-a3bf-5d645ca3e9dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.192989 Aug 30 01:16:57.845538 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 455/874] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:16:57 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:16:58.460636 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-7571b705-b25b-44c0-af63-c962670db66a req-4626046c-56e2-489c-9ea7-48b9326d02d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435521f1-f793-4834-9915-bb47962b6290", "tag": "5c856550-f785-48e4-8e57-b2cf53c786c7"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:16:58.473537 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-7571b705-b25b-44c0-af63-c962670db66a req-4626046c-56e2-489c-9ea7-48b9326d02d8 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:58.474053 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-7571b705-b25b-44c0-af63-c962670db66a req-4626046c-56e2-489c-9ea7-48b9326d02d8 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:58.474653 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-7571b705-b25b-44c0-af63-c962670db66a req-4626046c-56e2-489c-9ea7-48b9326d02d8 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:58.488740 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-7571b705-b25b-44c0-af63-c962670db66a req-4626046c-56e2-489c-9ea7-48b9326d02d8 service nova] Creating event network-changed:5c856550-f785-48e4-8e57-b2cf53c786c7 for instance 435521f1-f793-4834-9915-bb47962b6290 on hv-cinder-81571 Aug 30 01:16:58.494466 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-7571b705-b25b-44c0-af63-c962670db66a req-4626046c-56e2-489c-9ea7-48b9326d02d8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037737 Aug 30 01:16:58.495079 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 420/875] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:16:58.634752 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-880c2b79-8340-4198-95a6-a4de565bba76 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:58.635466 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-880c2b79-8340-4198-95a6-a4de565bba76 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:58.642955 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-880c2b79-8340-4198-95a6-a4de565bba76 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:58.643441 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-880c2b79-8340-4198-95a6-a4de565bba76 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:58.645854 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-880c2b79-8340-4198-95a6-a4de565bba76 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:58.645854 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-880c2b79-8340-4198-95a6-a4de565bba76 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:58.645854 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-880c2b79-8340-4198-95a6-a4de565bba76 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:58.645854 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-880c2b79-8340-4198-95a6-a4de565bba76 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:58.809255 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-880c2b79-8340-4198-95a6-a4de565bba76 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:58.817700 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a1bef371-a067-4223-bc4e-63ae662c75f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:58.818370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-880c2b79-8340-4198-95a6-a4de565bba76 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1755 microversion: 2.1 time: 0.187408 Aug 30 01:16:58.818821 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a1bef371-a067-4223-bc4e-63ae662c75f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:58.819305 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 456/876] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:58 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:16:58.826482 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1bef371-a067-4223-bc4e-63ae662c75f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:58.827331 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1bef371-a067-4223-bc4e-63ae662c75f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:58.827875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1bef371-a067-4223-bc4e-63ae662c75f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:58.828721 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1bef371-a067-4223-bc4e-63ae662c75f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:58.829282 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1bef371-a067-4223-bc4e-63ae662c75f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:58.830194 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a1bef371-a067-4223-bc4e-63ae662c75f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:58.868253 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-edb44e3a-31e6-4bae-a047-acfef9e641f2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:58.868883 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-edb44e3a-31e6-4bae-a047-acfef9e641f2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:58.875580 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-edb44e3a-31e6-4bae-a047-acfef9e641f2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:58.876064 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-edb44e3a-31e6-4bae-a047-acfef9e641f2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:58.876496 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-edb44e3a-31e6-4bae-a047-acfef9e641f2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:58.877200 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-edb44e3a-31e6-4bae-a047-acfef9e641f2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:58.877653 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-edb44e3a-31e6-4bae-a047-acfef9e641f2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:58.878105 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-edb44e3a-31e6-4bae-a047-acfef9e641f2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:59.024409 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-edb44e3a-31e6-4bae-a047-acfef9e641f2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:59.032858 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-edb44e3a-31e6-4bae-a047-acfef9e641f2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:59.038966 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-edb44e3a-31e6-4bae-a047-acfef9e641f2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:59.038966 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-edb44e3a-31e6-4bae-a047-acfef9e641f2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.171146 Aug 30 01:16:59.038966 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 457/877] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:16:58 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:16:59.053261 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a1bef371-a067-4223-bc4e-63ae662c75f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:16:59.061583 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a1bef371-a067-4223-bc4e-63ae662c75f1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1365 microversion: 2.1 time: 0.248159 Aug 30 01:16:59.062212 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 421/878] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:58 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:16:59.840357 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a2038720-af00-42d7-aa46-aca7b9fb325e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:16:59.844306 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a2038720-af00-42d7-aa46-aca7b9fb325e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:16:59.844306 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=4 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:16:59.848744 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2038720-af00-42d7-aa46-aca7b9fb325e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:59.849230 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2038720-af00-42d7-aa46-aca7b9fb325e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:59.849662 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2038720-af00-42d7-aa46-aca7b9fb325e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:59.850400 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2038720-af00-42d7-aa46-aca7b9fb325e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:16:59.850850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2038720-af00-42d7-aa46-aca7b9fb325e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:16:59.851300 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a2038720-af00-42d7-aa46-aca7b9fb325e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:16:59.998165 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a2038720-af00-42d7-aa46-aca7b9fb325e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:00.006487 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a2038720-af00-42d7-aa46-aca7b9fb325e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1755 microversion: 2.1 time: 0.170088 Aug 30 01:17:00.007056 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 458/879] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:16:59 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:00.059496 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6880b8a0-fbf4-4f37-9147-20f10d274be4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:00.060305 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6880b8a0-fbf4-4f37-9147-20f10d274be4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:00.068132 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6880b8a0-fbf4-4f37-9147-20f10d274be4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:00.068132 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6880b8a0-fbf4-4f37-9147-20f10d274be4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:00.068132 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6880b8a0-fbf4-4f37-9147-20f10d274be4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:00.068825 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6880b8a0-fbf4-4f37-9147-20f10d274be4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:00.069684 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6880b8a0-fbf4-4f37-9147-20f10d274be4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:00.069684 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6880b8a0-fbf4-4f37-9147-20f10d274be4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:00.085104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d12de071-0707-4eae-b8de-4f4970513bb7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:00.086447 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d12de071-0707-4eae-b8de-4f4970513bb7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:00.094906 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d12de071-0707-4eae-b8de-4f4970513bb7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:00.095310 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d12de071-0707-4eae-b8de-4f4970513bb7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:00.095788 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d12de071-0707-4eae-b8de-4f4970513bb7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:00.096476 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d12de071-0707-4eae-b8de-4f4970513bb7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:00.096933 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d12de071-0707-4eae-b8de-4f4970513bb7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:00.097786 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d12de071-0707-4eae-b8de-4f4970513bb7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:00.220919 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6880b8a0-fbf4-4f37-9147-20f10d274be4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:00.229320 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6880b8a0-fbf4-4f37-9147-20f10d274be4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:00.230860 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6880b8a0-fbf4-4f37-9147-20f10d274be4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:00.232708 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6880b8a0-fbf4-4f37-9147-20f10d274be4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.177248 Aug 30 01:17:00.233285 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 422/880] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:00 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:00.244174 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d12de071-0707-4eae-b8de-4f4970513bb7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:00.252815 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d12de071-0707-4eae-b8de-4f4970513bb7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1365 microversion: 2.1 time: 0.172085 Aug 30 01:17:00.253396 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 459/881] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:00 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:01.032589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-96a2b923-ceab-43a1-b112-05d18bf26919 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:01.033279 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-96a2b923-ceab-43a1-b112-05d18bf26919 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:01.040443 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96a2b923-ceab-43a1-b112-05d18bf26919 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:01.041036 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96a2b923-ceab-43a1-b112-05d18bf26919 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:01.041427 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96a2b923-ceab-43a1-b112-05d18bf26919 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:01.042179 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96a2b923-ceab-43a1-b112-05d18bf26919 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:01.042642 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96a2b923-ceab-43a1-b112-05d18bf26919 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:01.043098 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96a2b923-ceab-43a1-b112-05d18bf26919 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:01.206062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-96a2b923-ceab-43a1-b112-05d18bf26919 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:01.214495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-96a2b923-ceab-43a1-b112-05d18bf26919 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1755 microversion: 2.1 time: 0.189352 Aug 30 01:17:01.229654 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 423/882] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:01 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:01.256634 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0edec8a3-8fe7-4841-9782-339b1e30cd50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:01.257255 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0edec8a3-8fe7-4841-9782-339b1e30cd50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:01.263778 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0edec8a3-8fe7-4841-9782-339b1e30cd50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:01.264241 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0edec8a3-8fe7-4841-9782-339b1e30cd50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:01.264719 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0edec8a3-8fe7-4841-9782-339b1e30cd50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:01.265405 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0edec8a3-8fe7-4841-9782-339b1e30cd50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:01.265886 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0edec8a3-8fe7-4841-9782-339b1e30cd50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:01.266306 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0edec8a3-8fe7-4841-9782-339b1e30cd50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:01.273624 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1dbc3aee-973c-4297-8780-c8341c50b05c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:01.274461 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1dbc3aee-973c-4297-8780-c8341c50b05c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:01.282018 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1dbc3aee-973c-4297-8780-c8341c50b05c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:01.282637 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1dbc3aee-973c-4297-8780-c8341c50b05c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:01.283185 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1dbc3aee-973c-4297-8780-c8341c50b05c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:01.283983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1dbc3aee-973c-4297-8780-c8341c50b05c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:01.284536 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1dbc3aee-973c-4297-8780-c8341c50b05c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:01.285032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1dbc3aee-973c-4297-8780-c8341c50b05c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:01.426483 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0edec8a3-8fe7-4841-9782-339b1e30cd50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:01.437820 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1dbc3aee-973c-4297-8780-c8341c50b05c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:01.442915 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0edec8a3-8fe7-4841-9782-339b1e30cd50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:01.444477 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0edec8a3-8fe7-4841-9782-339b1e30cd50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:01.445829 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0edec8a3-8fe7-4841-9782-339b1e30cd50 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.193255 Aug 30 01:17:01.446349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1dbc3aee-973c-4297-8780-c8341c50b05c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1365 microversion: 2.1 time: 0.176549 Aug 30 01:17:01.446583 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 460/883] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:01 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:01.454072 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 424/884] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:01 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:02.238190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ee793446-f9e4-44f5-9563-92f082db81f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:02.238807 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ee793446-f9e4-44f5-9563-92f082db81f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:02.246038 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee793446-f9e4-44f5-9563-92f082db81f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:02.249098 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee793446-f9e4-44f5-9563-92f082db81f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:02.249098 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee793446-f9e4-44f5-9563-92f082db81f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:02.250167 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee793446-f9e4-44f5-9563-92f082db81f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:02.251447 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee793446-f9e4-44f5-9563-92f082db81f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:02.252211 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee793446-f9e4-44f5-9563-92f082db81f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:02.406177 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ee793446-f9e4-44f5-9563-92f082db81f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:02.416727 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ee793446-f9e4-44f5-9563-92f082db81f7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1758 microversion: 2.1 time: 0.183902 Aug 30 01:17:02.417308 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 461/885] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:02 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:02.469202 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c3c7ab02-954e-490f-948f-10b53fe6bd4a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:02.470006 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c3c7ab02-954e-490f-948f-10b53fe6bd4a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:02.476207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f870209a-ec66-4c17-adc6-87763d7f21d3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:02.476930 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab02-954e-490f-948f-10b53fe6bd4a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:02.477073 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f870209a-ec66-4c17-adc6-87763d7f21d3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:02.477421 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab02-954e-490f-948f-10b53fe6bd4a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:02.477963 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab02-954e-490f-948f-10b53fe6bd4a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:02.478769 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab02-954e-490f-948f-10b53fe6bd4a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:02.479239 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab02-954e-490f-948f-10b53fe6bd4a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:02.479760 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab02-954e-490f-948f-10b53fe6bd4a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:02.490381 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:02.492136 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f870209a-ec66-4c17-adc6-87763d7f21d3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:02.492834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f870209a-ec66-4c17-adc6-87763d7f21d3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:02.493269 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f870209a-ec66-4c17-adc6-87763d7f21d3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:02.494122 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f870209a-ec66-4c17-adc6-87763d7f21d3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:02.494453 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f870209a-ec66-4c17-adc6-87763d7f21d3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:02.494878 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f870209a-ec66-4c17-adc6-87763d7f21d3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:02.645353 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c3c7ab02-954e-490f-948f-10b53fe6bd4a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:02.649028 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:02.654523 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c3c7ab02-954e-490f-948f-10b53fe6bd4a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:02.656752 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c3c7ab02-954e-490f-948f-10b53fe6bd4a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:02.657982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c3c7ab02-954e-490f-948f-10b53fe6bd4a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.192852 Aug 30 01:17:02.658870 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 462/886] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:02 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:17:02.672013 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f870209a-ec66-4c17-adc6-87763d7f21d3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:02.679869 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f870209a-ec66-4c17-adc6-87763d7f21d3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1365 microversion: 2.1 time: 0.214667 Aug 30 01:17:02.680867 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 425/887] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:02 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:03.680724 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f5618475-c2e0-4a62-a6f6-eac3ea61117e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:03.681342 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f5618475-c2e0-4a62-a6f6-eac3ea61117e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:03.688422 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f5618475-c2e0-4a62-a6f6-eac3ea61117e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:03.688951 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f5618475-c2e0-4a62-a6f6-eac3ea61117e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:03.689392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f5618475-c2e0-4a62-a6f6-eac3ea61117e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:03.690116 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f5618475-c2e0-4a62-a6f6-eac3ea61117e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:03.690573 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f5618475-c2e0-4a62-a6f6-eac3ea61117e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:03.691087 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f5618475-c2e0-4a62-a6f6-eac3ea61117e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:03.704455 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3b9055f8-1fd1-4498-8807-6bcbf2df9621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:03.705069 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3b9055f8-1fd1-4498-8807-6bcbf2df9621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:03.707138 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=8 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:03.712294 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b9055f8-1fd1-4498-8807-6bcbf2df9621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:03.712779 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b9055f8-1fd1-4498-8807-6bcbf2df9621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:03.713217 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b9055f8-1fd1-4498-8807-6bcbf2df9621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:03.713936 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b9055f8-1fd1-4498-8807-6bcbf2df9621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:03.714388 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b9055f8-1fd1-4498-8807-6bcbf2df9621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:03.714821 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b9055f8-1fd1-4498-8807-6bcbf2df9621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:03.845256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f5618475-c2e0-4a62-a6f6-eac3ea61117e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:03.856706 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f5618475-c2e0-4a62-a6f6-eac3ea61117e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:03.859915 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f5618475-c2e0-4a62-a6f6-eac3ea61117e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:03.861211 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f5618475-c2e0-4a62-a6f6-eac3ea61117e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.184689 Aug 30 01:17:03.862262 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 463/888] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:03 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:03.876025 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3b9055f8-1fd1-4498-8807-6bcbf2df9621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:03.884349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3b9055f8-1fd1-4498-8807-6bcbf2df9621 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1365 microversion: 2.1 time: 0.184348 Aug 30 01:17:03.885770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 426/889] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:03 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:04.832885 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-759ee404-38a0-47ae-8857-9115e3d4c950 req-d0971fe9-01e7-470e-8535-69ad5d58b62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435521f1-f793-4834-9915-bb47962b6290", "name": "network-vif-plugged", "status": "completed", "tag": "5c856550-f785-48e4-8e57-b2cf53c786c7"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:04.842491 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-759ee404-38a0-47ae-8857-9115e3d4c950 req-d0971fe9-01e7-470e-8535-69ad5d58b62c service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:04.842971 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-759ee404-38a0-47ae-8857-9115e3d4c950 req-d0971fe9-01e7-470e-8535-69ad5d58b62c service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:04.843423 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-759ee404-38a0-47ae-8857-9115e3d4c950 req-d0971fe9-01e7-470e-8535-69ad5d58b62c service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:04.854672 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-759ee404-38a0-47ae-8857-9115e3d4c950 req-d0971fe9-01e7-470e-8535-69ad5d58b62c service nova] Creating event network-vif-plugged:5c856550-f785-48e4-8e57-b2cf53c786c7 for instance 435521f1-f793-4834-9915-bb47962b6290 on hv-cinder-81571 Aug 30 01:17:04.859795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-759ee404-38a0-47ae-8857-9115e3d4c950 req-d0971fe9-01e7-470e-8535-69ad5d58b62c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161900 Aug 30 01:17:04.860435 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 464/890] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:04.890588 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f49ab5e6-0324-41a6-9a68-c9d20193e90b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:04.891200 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f49ab5e6-0324-41a6-9a68-c9d20193e90b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:04.898445 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f49ab5e6-0324-41a6-9a68-c9d20193e90b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:04.898932 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f49ab5e6-0324-41a6-9a68-c9d20193e90b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:04.899371 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f49ab5e6-0324-41a6-9a68-c9d20193e90b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:04.900061 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f49ab5e6-0324-41a6-9a68-c9d20193e90b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:04.900517 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f49ab5e6-0324-41a6-9a68-c9d20193e90b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:04.901277 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f49ab5e6-0324-41a6-9a68-c9d20193e90b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:04.911103 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6c591ba7-7eb6-4766-82a9-d5bfb27897f5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:04.911103 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6c591ba7-7eb6-4766-82a9-d5bfb27897f5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:04.916172 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c591ba7-7eb6-4766-82a9-d5bfb27897f5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:04.927002 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c591ba7-7eb6-4766-82a9-d5bfb27897f5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:04.927741 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c591ba7-7eb6-4766-82a9-d5bfb27897f5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:04.929293 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c591ba7-7eb6-4766-82a9-d5bfb27897f5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:04.930548 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c591ba7-7eb6-4766-82a9-d5bfb27897f5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:04.931230 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c591ba7-7eb6-4766-82a9-d5bfb27897f5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:05.070002 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f49ab5e6-0324-41a6-9a68-c9d20193e90b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:05.080160 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f49ab5e6-0324-41a6-9a68-c9d20193e90b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:05.081597 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f49ab5e6-0324-41a6-9a68-c9d20193e90b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:05.082813 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f49ab5e6-0324-41a6-9a68-c9d20193e90b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.196889 Aug 30 01:17:05.083452 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 427/891] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:04 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:05.089460 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dbf78da2-432f-47d6-a3db-fe312c6b21b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:05.091406 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dbf78da2-432f-47d6-a3db-fe312c6b21b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:05.097841 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbf78da2-432f-47d6-a3db-fe312c6b21b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:05.098568 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbf78da2-432f-47d6-a3db-fe312c6b21b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:05.099165 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbf78da2-432f-47d6-a3db-fe312c6b21b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:05.100045 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbf78da2-432f-47d6-a3db-fe312c6b21b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:05.100649 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbf78da2-432f-47d6-a3db-fe312c6b21b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:05.101233 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbf78da2-432f-47d6-a3db-fe312c6b21b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:05.107165 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6c591ba7-7eb6-4766-82a9-d5bfb27897f5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:05.115807 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6c591ba7-7eb6-4766-82a9-d5bfb27897f5 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1365 microversion: 2.1 time: 0.213297 Aug 30 01:17:05.118079 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 465/892] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:04 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:05.133933 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dbf78da2-432f-47d6-a3db-fe312c6b21b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049115 Aug 30 01:17:05.134500 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 428/893] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:17:05 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:05.146719 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5fcfd7d7-23b9-4101-a4e1-3ba649f7a7b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:05.147212 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5fcfd7d7-23b9-4101-a4e1-3ba649f7a7b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:05.153253 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fcfd7d7-23b9-4101-a4e1-3ba649f7a7b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:05.153751 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fcfd7d7-23b9-4101-a4e1-3ba649f7a7b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:05.154253 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fcfd7d7-23b9-4101-a4e1-3ba649f7a7b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:05.155409 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fcfd7d7-23b9-4101-a4e1-3ba649f7a7b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:05.155872 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fcfd7d7-23b9-4101-a4e1-3ba649f7a7b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:05.156300 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fcfd7d7-23b9-4101-a4e1-3ba649f7a7b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:05.187600 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5fcfd7d7-23b9-4101-a4e1-3ba649f7a7b1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments/05f83d94-aac7-424a-befd-413bb102413d" status: 200 len: 194 microversion: 2.1 time: 0.044799 Aug 30 01:17:05.188214 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 466/894] 10.222.0.52 () {58 vars in 1413 bytes} [Tue Aug 30 01:17:05 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments/05f83d94-aac7-424a-befd-413bb102413d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:06.111044 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-90524ba7-e89d-461c-a507-9d8ee5e2b507 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:06.111668 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-90524ba7-e89d-461c-a507-9d8ee5e2b507 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:06.118245 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90524ba7-e89d-461c-a507-9d8ee5e2b507 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:06.118696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90524ba7-e89d-461c-a507-9d8ee5e2b507 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:06.119137 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90524ba7-e89d-461c-a507-9d8ee5e2b507 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:06.119834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90524ba7-e89d-461c-a507-9d8ee5e2b507 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:06.120289 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90524ba7-e89d-461c-a507-9d8ee5e2b507 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:06.120779 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90524ba7-e89d-461c-a507-9d8ee5e2b507 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:06.137302 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-72a1f505-4241-455b-9e6b-b99d7ec732b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:06.141454 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-72a1f505-4241-455b-9e6b-b99d7ec732b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:06.145643 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-72a1f505-4241-455b-9e6b-b99d7ec732b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:06.146220 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-72a1f505-4241-455b-9e6b-b99d7ec732b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:06.146664 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-72a1f505-4241-455b-9e6b-b99d7ec732b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:06.147373 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-72a1f505-4241-455b-9e6b-b99d7ec732b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:06.147834 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-72a1f505-4241-455b-9e6b-b99d7ec732b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:06.148286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-72a1f505-4241-455b-9e6b-b99d7ec732b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:06.268067 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-90524ba7-e89d-461c-a507-9d8ee5e2b507 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:06.275063 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-90524ba7-e89d-461c-a507-9d8ee5e2b507 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:06.276871 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-90524ba7-e89d-461c-a507-9d8ee5e2b507 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:06.278333 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-90524ba7-e89d-461c-a507-9d8ee5e2b507 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.171814 Aug 30 01:17:06.279154 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 429/895] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:06 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:06.285617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-72a1f505-4241-455b-9e6b-b99d7ec732b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:06.297642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-72a1f505-4241-455b-9e6b-b99d7ec732b3 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1365 microversion: 2.1 time: 0.160646 Aug 30 01:17:06.298350 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 467/896] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:06 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:07.076438 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ed0f3931-95eb-4332-a1da-7a1503c13922 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "035a2b6b-0854-4958-aad4-86544a1eadf0"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:07.078796 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ed0f3931-95eb-4332-a1da-7a1503c13922 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:07.092443 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed0f3931-95eb-4332-a1da-7a1503c13922 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:07.092443 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed0f3931-95eb-4332-a1da-7a1503c13922 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:07.092443 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed0f3931-95eb-4332-a1da-7a1503c13922 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:07.092443 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed0f3931-95eb-4332-a1da-7a1503c13922 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:07.093210 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed0f3931-95eb-4332-a1da-7a1503c13922 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:07.093210 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed0f3931-95eb-4332-a1da-7a1503c13922 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:07.302634 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ebd24f36-21cf-4fa9-9519-f899f1970f89 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:07.303251 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ebd24f36-21cf-4fa9-9519-f899f1970f89 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:07.309881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebd24f36-21cf-4fa9-9519-f899f1970f89 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:07.310906 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebd24f36-21cf-4fa9-9519-f899f1970f89 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:07.311381 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebd24f36-21cf-4fa9-9519-f899f1970f89 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:07.312134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebd24f36-21cf-4fa9-9519-f899f1970f89 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:07.312635 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebd24f36-21cf-4fa9-9519-f899f1970f89 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:07.313069 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebd24f36-21cf-4fa9-9519-f899f1970f89 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:07.450294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ebd24f36-21cf-4fa9-9519-f899f1970f89 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:07.458934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ebd24f36-21cf-4fa9-9519-f899f1970f89 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:07.460475 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ebd24f36-21cf-4fa9-9519-f899f1970f89 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:07.461642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ebd24f36-21cf-4fa9-9519-f899f1970f89 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.163156 Aug 30 01:17:07.462232 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 468/897] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:07 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:17:07.466806 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-3a5160ae-7ff9-40c7-8844-ea4514dbf363 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:07.471483 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-3a5160ae-7ff9-40c7-8844-ea4514dbf363 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:07.473789 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a5160ae-7ff9-40c7-8844-ea4514dbf363 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:07.474289 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a5160ae-7ff9-40c7-8844-ea4514dbf363 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:07.474729 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a5160ae-7ff9-40c7-8844-ea4514dbf363 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:07.475441 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a5160ae-7ff9-40c7-8844-ea4514dbf363 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:07.475900 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a5160ae-7ff9-40c7-8844-ea4514dbf363 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:07.476335 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a5160ae-7ff9-40c7-8844-ea4514dbf363 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:07.617460 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-3a5160ae-7ff9-40c7-8844-ea4514dbf363 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:07.626694 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-3a5160ae-7ff9-40c7-8844-ea4514dbf363 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1556 microversion: 2.1 time: 0.163241 Aug 30 01:17:07.627188 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 469/898] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:07 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:07.651689 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b9b6d3d0-618d-4efc-988f-1236777a5f01 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:07.652195 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b9b6d3d0-618d-4efc-988f-1236777a5f01 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:07.660462 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b9b6d3d0-618d-4efc-988f-1236777a5f01 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:07.661035 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b9b6d3d0-618d-4efc-988f-1236777a5f01 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:07.661661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b9b6d3d0-618d-4efc-988f-1236777a5f01 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:07.662472 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b9b6d3d0-618d-4efc-988f-1236777a5f01 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:07.662937 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b9b6d3d0-618d-4efc-988f-1236777a5f01 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:07.663356 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b9b6d3d0-618d-4efc-988f-1236777a5f01 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:07.746496 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-b9b6d3d0-618d-4efc-988f-1236777a5f01 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099026 Aug 30 01:17:07.748016 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 470/899] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 30 01:17:07 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:08.014950 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ed0f3931-95eb-4332-a1da-7a1503c13922 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "POST /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.941497 Aug 30 01:17:08.015820 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 430/900] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 30 01:17:07 2022] POST /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments => generated 194 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:08.495424 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ebe2202e-f0d9-4cb7-b28a-b65b7a5675dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:08.496107 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ebe2202e-f0d9-4cb7-b28a-b65b7a5675dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:08.503653 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebe2202e-f0d9-4cb7-b28a-b65b7a5675dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:08.504693 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebe2202e-f0d9-4cb7-b28a-b65b7a5675dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:08.504693 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebe2202e-f0d9-4cb7-b28a-b65b7a5675dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:08.505614 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebe2202e-f0d9-4cb7-b28a-b65b7a5675dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:08.506183 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebe2202e-f0d9-4cb7-b28a-b65b7a5675dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:08.506594 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ebe2202e-f0d9-4cb7-b28a-b65b7a5675dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:08.904303 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ebe2202e-f0d9-4cb7-b28a-b65b7a5675dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:08.913750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ebe2202e-f0d9-4cb7-b28a-b65b7a5675dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:08.923109 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ebe2202e-f0d9-4cb7-b28a-b65b7a5675dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:08.923109 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ebe2202e-f0d9-4cb7-b28a-b65b7a5675dd tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.427654 Aug 30 01:17:08.923109 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 471/901] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:08 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:09.395896 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-d53ea4e5-b910-4282-b834-324e6c17e9bc req-edae7cf7-fa78-4c78-b06b-419b6c1c443e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435521f1-f793-4834-9915-bb47962b6290", "tag": "5c856550-f785-48e4-8e57-b2cf53c786c7"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:09.406807 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d53ea4e5-b910-4282-b834-324e6c17e9bc req-edae7cf7-fa78-4c78-b06b-419b6c1c443e service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:09.407201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d53ea4e5-b910-4282-b834-324e6c17e9bc req-edae7cf7-fa78-4c78-b06b-419b6c1c443e service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:09.407846 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d53ea4e5-b910-4282-b834-324e6c17e9bc req-edae7cf7-fa78-4c78-b06b-419b6c1c443e service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:09.419097 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-d53ea4e5-b910-4282-b834-324e6c17e9bc req-edae7cf7-fa78-4c78-b06b-419b6c1c443e service nova] Creating event network-changed:5c856550-f785-48e4-8e57-b2cf53c786c7 for instance 435521f1-f793-4834-9915-bb47962b6290 on hv-cinder-81571 Aug 30 01:17:09.424351 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-d53ea4e5-b910-4282-b834-324e6c17e9bc req-edae7cf7-fa78-4c78-b06b-419b6c1c443e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241310 Aug 30 01:17:09.426619 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 431/902] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:09.945054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e191428c-51df-4b82-80a1-649086301d06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:09.946355 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e191428c-51df-4b82-80a1-649086301d06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:09.964153 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e191428c-51df-4b82-80a1-649086301d06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:09.967459 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e191428c-51df-4b82-80a1-649086301d06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:09.968167 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e191428c-51df-4b82-80a1-649086301d06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:09.969789 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e191428c-51df-4b82-80a1-649086301d06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:09.970923 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e191428c-51df-4b82-80a1-649086301d06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:09.971559 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e191428c-51df-4b82-80a1-649086301d06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:10.166247 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e191428c-51df-4b82-80a1-649086301d06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:10.178679 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e191428c-51df-4b82-80a1-649086301d06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:10.180508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e191428c-51df-4b82-80a1-649086301d06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:10.182318 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e191428c-51df-4b82-80a1-649086301d06 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.243894 Aug 30 01:17:10.183587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 472/903] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:09 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:11.209478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ae1800a7-ed46-40a2-931c-9f5a381d5e86 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:11.210201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ae1800a7-ed46-40a2-931c-9f5a381d5e86 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:11.216355 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae1800a7-ed46-40a2-931c-9f5a381d5e86 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:11.216823 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae1800a7-ed46-40a2-931c-9f5a381d5e86 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:11.217249 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae1800a7-ed46-40a2-931c-9f5a381d5e86 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:11.217958 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae1800a7-ed46-40a2-931c-9f5a381d5e86 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:11.218416 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae1800a7-ed46-40a2-931c-9f5a381d5e86 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:11.218832 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae1800a7-ed46-40a2-931c-9f5a381d5e86 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:11.352063 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ae1800a7-ed46-40a2-931c-9f5a381d5e86 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:11.361005 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ae1800a7-ed46-40a2-931c-9f5a381d5e86 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:11.365388 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ae1800a7-ed46-40a2-931c-9f5a381d5e86 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:11.365388 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ae1800a7-ed46-40a2-931c-9f5a381d5e86 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1742 microversion: 2.20 time: 0.158814 Aug 30 01:17:11.365388 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 432/904] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:11 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:17:12.388840 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c3cbbb8b-edd0-48b6-81f3-34311c0ad04b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:12.390227 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c3cbbb8b-edd0-48b6-81f3-34311c0ad04b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:12.397654 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c3cbbb8b-edd0-48b6-81f3-34311c0ad04b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:12.398884 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c3cbbb8b-edd0-48b6-81f3-34311c0ad04b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:12.399306 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c3cbbb8b-edd0-48b6-81f3-34311c0ad04b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:12.400004 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c3cbbb8b-edd0-48b6-81f3-34311c0ad04b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:12.400467 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c3cbbb8b-edd0-48b6-81f3-34311c0ad04b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:12.401117 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c3cbbb8b-edd0-48b6-81f3-34311c0ad04b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:12.552219 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c3cbbb8b-edd0-48b6-81f3-34311c0ad04b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:12.561555 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c3cbbb8b-edd0-48b6-81f3-34311c0ad04b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:12.564021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c3cbbb8b-edd0-48b6-81f3-34311c0ad04b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:12.565098 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c3cbbb8b-edd0-48b6-81f3-34311c0ad04b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1737 microversion: 2.20 time: 0.180444 Aug 30 01:17:12.569814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 473/905] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:12 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:17:13.589871 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-37f9fc6e-ca9c-4453-9fb2-1b0213b73086 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:13.591358 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-37f9fc6e-ca9c-4453-9fb2-1b0213b73086 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:13.600592 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37f9fc6e-ca9c-4453-9fb2-1b0213b73086 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:13.601178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37f9fc6e-ca9c-4453-9fb2-1b0213b73086 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:13.601688 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37f9fc6e-ca9c-4453-9fb2-1b0213b73086 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:13.602658 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37f9fc6e-ca9c-4453-9fb2-1b0213b73086 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:13.603142 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37f9fc6e-ca9c-4453-9fb2-1b0213b73086 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:13.603806 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37f9fc6e-ca9c-4453-9fb2-1b0213b73086 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:13.781402 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-37f9fc6e-ca9c-4453-9fb2-1b0213b73086 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:13.791408 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-37f9fc6e-ca9c-4453-9fb2-1b0213b73086 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:13.793216 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-37f9fc6e-ca9c-4453-9fb2-1b0213b73086 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:13.798705 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-37f9fc6e-ca9c-4453-9fb2-1b0213b73086 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1737 microversion: 2.20 time: 0.212598 Aug 30 01:17:13.814451 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 433/906] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:13 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:14.745407 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-caaa71f6-d5e3-4fbe-b5f1-fa7554c7b559 req-77c54347-ab54-41d1-ade6-0d9f7baecaef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b743eb-1b3f-458d-ad48-d60c3934ba0d", "name": "network-vif-plugged", "status": "completed", "tag": "adb8f445-f2e5-41a5-91ba-43406b91be88"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:14.776837 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-caaa71f6-d5e3-4fbe-b5f1-fa7554c7b559 req-77c54347-ab54-41d1-ade6-0d9f7baecaef service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:14.779067 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-caaa71f6-d5e3-4fbe-b5f1-fa7554c7b559 req-77c54347-ab54-41d1-ade6-0d9f7baecaef service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:14.781520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-caaa71f6-d5e3-4fbe-b5f1-fa7554c7b559 req-77c54347-ab54-41d1-ade6-0d9f7baecaef service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:14.809958 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-caaa71f6-d5e3-4fbe-b5f1-fa7554c7b559 req-77c54347-ab54-41d1-ade6-0d9f7baecaef service nova] Creating event network-vif-plugged:adb8f445-f2e5-41a5-91ba-43406b91be88 for instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d on hv-cinder-81571 Aug 30 01:17:14.822216 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-caaa71f6-d5e3-4fbe-b5f1-fa7554c7b559 req-77c54347-ab54-41d1-ade6-0d9f7baecaef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083516 Aug 30 01:17:14.823426 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 474/907] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:14.826711 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c8573530-fa3f-4069-ac6f-990b3611110c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:14.828181 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c8573530-fa3f-4069-ac6f-990b3611110c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:14.837276 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8573530-fa3f-4069-ac6f-990b3611110c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:14.838120 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8573530-fa3f-4069-ac6f-990b3611110c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:14.838921 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8573530-fa3f-4069-ac6f-990b3611110c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:14.840195 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8573530-fa3f-4069-ac6f-990b3611110c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:14.842473 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8573530-fa3f-4069-ac6f-990b3611110c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:14.843131 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8573530-fa3f-4069-ac6f-990b3611110c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:14.869553 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:15.058738 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c8573530-fa3f-4069-ac6f-990b3611110c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:15.073327 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c8573530-fa3f-4069-ac6f-990b3611110c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:15.080994 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c8573530-fa3f-4069-ac6f-990b3611110c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:15.084984 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c8573530-fa3f-4069-ac6f-990b3611110c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1737 microversion: 2.20 time: 0.263305 Aug 30 01:17:15.086323 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 434/908] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:14 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1737 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:17:16.111375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2adaacf9-8dd6-47eb-8921-b32cbc8b8a60 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:16.112875 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2adaacf9-8dd6-47eb-8921-b32cbc8b8a60 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:16.120090 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2adaacf9-8dd6-47eb-8921-b32cbc8b8a60 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:16.120983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2adaacf9-8dd6-47eb-8921-b32cbc8b8a60 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:16.121933 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2adaacf9-8dd6-47eb-8921-b32cbc8b8a60 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:16.123152 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2adaacf9-8dd6-47eb-8921-b32cbc8b8a60 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:16.123815 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2adaacf9-8dd6-47eb-8921-b32cbc8b8a60 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:16.124482 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2adaacf9-8dd6-47eb-8921-b32cbc8b8a60 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:16.303908 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2adaacf9-8dd6-47eb-8921-b32cbc8b8a60 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:16.313651 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2adaacf9-8dd6-47eb-8921-b32cbc8b8a60 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:16.315503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2adaacf9-8dd6-47eb-8921-b32cbc8b8a60 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:16.317079 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2adaacf9-8dd6-47eb-8921-b32cbc8b8a60 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1737 microversion: 2.20 time: 0.212033 Aug 30 01:17:16.318224 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 475/909] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:16 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:17:16.710166 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0d7fb577-1e1e-4a73-8f30-584a21f2d85b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:16.715389 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0d7fb577-1e1e-4a73-8f30-584a21f2d85b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:16.722812 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d7fb577-1e1e-4a73-8f30-584a21f2d85b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:16.723308 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d7fb577-1e1e-4a73-8f30-584a21f2d85b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:16.723743 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d7fb577-1e1e-4a73-8f30-584a21f2d85b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:16.724450 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d7fb577-1e1e-4a73-8f30-584a21f2d85b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:16.724906 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d7fb577-1e1e-4a73-8f30-584a21f2d85b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:16.725333 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0d7fb577-1e1e-4a73-8f30-584a21f2d85b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:16.763831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0d7fb577-1e1e-4a73-8f30-584a21f2d85b tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058360 Aug 30 01:17:16.769766 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 435/910] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:17:16 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:17:16.905629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-13471096-941a-4a1a-9171-a67515dc7f3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:16.906500 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-13471096-941a-4a1a-9171-a67515dc7f3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:16.908484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:16.916329 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13471096-941a-4a1a-9171-a67515dc7f3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:16.924934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13471096-941a-4a1a-9171-a67515dc7f3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:16.924934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13471096-941a-4a1a-9171-a67515dc7f3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:16.925932 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13471096-941a-4a1a-9171-a67515dc7f3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:16.926449 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13471096-941a-4a1a-9171-a67515dc7f3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:16.926907 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13471096-941a-4a1a-9171-a67515dc7f3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:16.966359 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-13471096-941a-4a1a-9171-a67515dc7f3f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments/05f83d94-aac7-424a-befd-413bb102413d" status: 200 len: 194 microversion: 2.1 time: 0.064412 Aug 30 01:17:16.967444 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 476/911] 10.222.0.52 () {58 vars in 1413 bytes} [Tue Aug 30 01:17:16 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments/05f83d94-aac7-424a-befd-413bb102413d => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:16.979642 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9a2a164f-1fee-431b-94bb-8c910270b3a9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:16.980588 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9a2a164f-1fee-431b-94bb-8c910270b3a9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:16.992047 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a2a164f-1fee-431b-94bb-8c910270b3a9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:16.992541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a2a164f-1fee-431b-94bb-8c910270b3a9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:16.992977 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a2a164f-1fee-431b-94bb-8c910270b3a9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:16.993680 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a2a164f-1fee-431b-94bb-8c910270b3a9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:16.994162 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a2a164f-1fee-431b-94bb-8c910270b3a9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:16.994595 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a2a164f-1fee-431b-94bb-8c910270b3a9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:17.101665 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-9a2a164f-1fee-431b-94bb-8c910270b3a9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lazy-loading 'services' on Instance uuid 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:17:17.350389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2841b757-f279-4bed-8369-3d312c86ce84 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:17.351351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2841b757-f279-4bed-8369-3d312c86ce84 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:17.363890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2841b757-f279-4bed-8369-3d312c86ce84 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:17.365110 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2841b757-f279-4bed-8369-3d312c86ce84 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:17.365916 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2841b757-f279-4bed-8369-3d312c86ce84 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:17.367361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2841b757-f279-4bed-8369-3d312c86ce84 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:17.368807 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2841b757-f279-4bed-8369-3d312c86ce84 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:17.369401 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2841b757-f279-4bed-8369-3d312c86ce84 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:17.381178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9a2a164f-1fee-431b-94bb-8c910270b3a9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments/05f83d94-aac7-424a-befd-413bb102413d" status: 202 len: 0 microversion: 2.1 time: 0.406491 Aug 30 01:17:17.382460 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 436/912] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 30 01:17:16 2022] DELETE /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments/05f83d94-aac7-424a-befd-413bb102413d => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:17:17.609784 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2841b757-f279-4bed-8369-3d312c86ce84 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:17.619529 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2841b757-f279-4bed-8369-3d312c86ce84 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:17.621480 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2841b757-f279-4bed-8369-3d312c86ce84 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:17.623109 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2841b757-f279-4bed-8369-3d312c86ce84 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1737 microversion: 2.20 time: 0.279827 Aug 30 01:17:17.629780 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 477/913] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:17 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1737 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:18.652149 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9ab3b02c-5195-4ab2-8cbc-2264d318d55e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:18.652839 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9ab3b02c-5195-4ab2-8cbc-2264d318d55e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:18.657280 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:18.661598 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ab3b02c-5195-4ab2-8cbc-2264d318d55e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:18.662124 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ab3b02c-5195-4ab2-8cbc-2264d318d55e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:18.662650 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ab3b02c-5195-4ab2-8cbc-2264d318d55e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:18.663403 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ab3b02c-5195-4ab2-8cbc-2264d318d55e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:18.664059 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ab3b02c-5195-4ab2-8cbc-2264d318d55e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:18.664922 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ab3b02c-5195-4ab2-8cbc-2264d318d55e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:18.832748 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9ab3b02c-5195-4ab2-8cbc-2264d318d55e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:18.841454 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9ab3b02c-5195-4ab2-8cbc-2264d318d55e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:18.842989 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9ab3b02c-5195-4ab2-8cbc-2264d318d55e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:18.845521 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9ab3b02c-5195-4ab2-8cbc-2264d318d55e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1737 microversion: 2.20 time: 0.199014 Aug 30 01:17:18.845888 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 437/914] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:18 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:19.655598 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9335dc54-e492-439d-94b1-4de1786c7d01 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:19.657104 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9335dc54-e492-439d-94b1-4de1786c7d01 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:19.664015 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9335dc54-e492-439d-94b1-4de1786c7d01 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:19.665580 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9335dc54-e492-439d-94b1-4de1786c7d01 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:19.666298 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9335dc54-e492-439d-94b1-4de1786c7d01 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:19.667352 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9335dc54-e492-439d-94b1-4de1786c7d01 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:19.667847 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9335dc54-e492-439d-94b1-4de1786c7d01 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:19.668341 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9335dc54-e492-439d-94b1-4de1786c7d01 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:19.709717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9335dc54-e492-439d-94b1-4de1786c7d01 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments/035a2b6b-0854-4958-aad4-86544a1eadf0" status: 200 len: 194 microversion: 2.1 time: 0.058766 Aug 30 01:17:19.711939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 478/915] 10.222.0.52 () {58 vars in 1413 bytes} [Tue Aug 30 01:17:19 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments/035a2b6b-0854-4958-aad4-86544a1eadf0 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:19.722560 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d17ff4cc-371e-4786-bd0a-2c5bd30db89d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:19.724588 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d17ff4cc-371e-4786-bd0a-2c5bd30db89d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:19.735069 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d17ff4cc-371e-4786-bd0a-2c5bd30db89d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:19.735899 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d17ff4cc-371e-4786-bd0a-2c5bd30db89d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:19.736334 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d17ff4cc-371e-4786-bd0a-2c5bd30db89d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:19.737276 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d17ff4cc-371e-4786-bd0a-2c5bd30db89d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:19.737919 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d17ff4cc-371e-4786-bd0a-2c5bd30db89d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:19.738504 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d17ff4cc-371e-4786-bd0a-2c5bd30db89d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:19.850795 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-d17ff4cc-371e-4786-bd0a-2c5bd30db89d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lazy-loading 'services' on Instance uuid 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:17:19.868605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-64bd4598-4038-46de-8b81-c9b8864fede0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:19.869315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-64bd4598-4038-46de-8b81-c9b8864fede0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:19.881220 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-64bd4598-4038-46de-8b81-c9b8864fede0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:19.886135 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-64bd4598-4038-46de-8b81-c9b8864fede0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:19.886821 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-64bd4598-4038-46de-8b81-c9b8864fede0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:19.887712 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-64bd4598-4038-46de-8b81-c9b8864fede0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:19.888219 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-64bd4598-4038-46de-8b81-c9b8864fede0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:19.888720 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-64bd4598-4038-46de-8b81-c9b8864fede0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:20.041121 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-64bd4598-4038-46de-8b81-c9b8864fede0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:20.051361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-64bd4598-4038-46de-8b81-c9b8864fede0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:20.053216 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-64bd4598-4038-46de-8b81-c9b8864fede0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:20.054417 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-64bd4598-4038-46de-8b81-c9b8864fede0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1737 microversion: 2.20 time: 0.189830 Aug 30 01:17:20.054968 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 479/916] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:19 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:20.109915 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d17ff4cc-371e-4786-bd0a-2c5bd30db89d tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments/035a2b6b-0854-4958-aad4-86544a1eadf0" status: 202 len: 0 microversion: 2.1 time: 0.390708 Aug 30 01:17:20.115636 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 438/917] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 30 01:17:19 2022] DELETE /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments/035a2b6b-0854-4958-aad4-86544a1eadf0 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:17:21.081664 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-88f3336a-2edf-4f2a-a0ec-0bbf7aa52038 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:21.082884 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-88f3336a-2edf-4f2a-a0ec-0bbf7aa52038 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:21.096489 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-88f3336a-2edf-4f2a-a0ec-0bbf7aa52038 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:21.097353 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-88f3336a-2edf-4f2a-a0ec-0bbf7aa52038 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:21.097896 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-88f3336a-2edf-4f2a-a0ec-0bbf7aa52038 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:21.098713 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-88f3336a-2edf-4f2a-a0ec-0bbf7aa52038 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:21.099281 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-88f3336a-2edf-4f2a-a0ec-0bbf7aa52038 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:21.099881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-88f3336a-2edf-4f2a-a0ec-0bbf7aa52038 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:21.292565 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-88f3336a-2edf-4f2a-a0ec-0bbf7aa52038 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:21.307211 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-88f3336a-2edf-4f2a-a0ec-0bbf7aa52038 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:21.308945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-88f3336a-2edf-4f2a-a0ec-0bbf7aa52038 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:21.310367 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-88f3336a-2edf-4f2a-a0ec-0bbf7aa52038 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1737 microversion: 2.20 time: 0.234131 Aug 30 01:17:21.311089 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 480/918] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:21 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:22.336841 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-03c20f73-a866-40ae-8121-443effd28865 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:22.337627 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-03c20f73-a866-40ae-8121-443effd28865 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:22.345627 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03c20f73-a866-40ae-8121-443effd28865 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:22.346337 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03c20f73-a866-40ae-8121-443effd28865 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:22.347141 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03c20f73-a866-40ae-8121-443effd28865 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:22.347819 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03c20f73-a866-40ae-8121-443effd28865 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:22.348610 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03c20f73-a866-40ae-8121-443effd28865 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:22.349121 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-03c20f73-a866-40ae-8121-443effd28865 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:22.397328 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-3beae1d8-5f9b-47d8-92c1-5fc2e2e654c9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:22.399711 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-3beae1d8-5f9b-47d8-92c1-5fc2e2e654c9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:22.407604 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3beae1d8-5f9b-47d8-92c1-5fc2e2e654c9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:22.408098 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3beae1d8-5f9b-47d8-92c1-5fc2e2e654c9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:22.408691 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3beae1d8-5f9b-47d8-92c1-5fc2e2e654c9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:22.409430 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3beae1d8-5f9b-47d8-92c1-5fc2e2e654c9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:22.410087 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3beae1d8-5f9b-47d8-92c1-5fc2e2e654c9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:22.410537 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3beae1d8-5f9b-47d8-92c1-5fc2e2e654c9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:22.415691 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=100 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:22.447758 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-3beae1d8-5f9b-47d8-92c1-5fc2e2e654c9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054441 Aug 30 01:17:22.448414 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 481/919] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:17:22 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 01:17:22.598510 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5fe47f97-d9c6-4b14-ab0c-5ba7007d73af tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:22.600745 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5fe47f97-d9c6-4b14-ab0c-5ba7007d73af tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:22.607118 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fe47f97-d9c6-4b14-ab0c-5ba7007d73af tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:22.607627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fe47f97-d9c6-4b14-ab0c-5ba7007d73af tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:22.608063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fe47f97-d9c6-4b14-ab0c-5ba7007d73af tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:22.609414 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fe47f97-d9c6-4b14-ab0c-5ba7007d73af tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:22.610030 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fe47f97-d9c6-4b14-ab0c-5ba7007d73af tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:22.610449 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fe47f97-d9c6-4b14-ab0c-5ba7007d73af tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:22.643567 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5fe47f97-d9c6-4b14-ab0c-5ba7007d73af tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049362 Aug 30 01:17:22.644508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 482/920] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:17:22 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 01:17:22.722831 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-7df7f9d7-a97b-4624-99c0-607a51bef9d4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:22.723245 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-7df7f9d7-a97b-4624-99c0-607a51bef9d4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:22.729957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7df7f9d7-a97b-4624-99c0-607a51bef9d4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:22.730457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7df7f9d7-a97b-4624-99c0-607a51bef9d4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:22.730923 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7df7f9d7-a97b-4624-99c0-607a51bef9d4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:22.731755 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7df7f9d7-a97b-4624-99c0-607a51bef9d4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:22.732209 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7df7f9d7-a97b-4624-99c0-607a51bef9d4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:22.732642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7df7f9d7-a97b-4624-99c0-607a51bef9d4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:22.759746 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-7df7f9d7-a97b-4624-99c0-607a51bef9d4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Going to try to terminate instance {{(pid=121233) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:17:22.778583 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-03c20f73-a866-40ae-8121-443effd28865 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:22.793277 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-03c20f73-a866-40ae-8121-443effd28865 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:22.794959 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-03c20f73-a866-40ae-8121-443effd28865 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:22.796315 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-03c20f73-a866-40ae-8121-443effd28865 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1737 microversion: 2.20 time: 0.464226 Aug 30 01:17:22.797219 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 439/921] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:22 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1737 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:23.240209 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-7df7f9d7-a97b-4624-99c0-607a51bef9d4 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 204 len: 0 microversion: 2.1 time: 0.521846 Aug 30 01:17:23.240799 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 483/922] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:17:22 2022] DELETE /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 01:17:23.250842 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8bb7b779-f6f0-48c3-9767-8e866b667bd7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:23.251703 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8bb7b779-f6f0-48c3-9767-8e866b667bd7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:23.258329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8bb7b779-f6f0-48c3-9767-8e866b667bd7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:23.259190 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8bb7b779-f6f0-48c3-9767-8e866b667bd7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:23.259682 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8bb7b779-f6f0-48c3-9767-8e866b667bd7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:23.260418 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8bb7b779-f6f0-48c3-9767-8e866b667bd7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:23.260874 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8bb7b779-f6f0-48c3-9767-8e866b667bd7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:23.261303 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8bb7b779-f6f0-48c3-9767-8e866b667bd7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:23.440442 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8bb7b779-f6f0-48c3-9767-8e866b667bd7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:23.452938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8bb7b779-f6f0-48c3-9767-8e866b667bd7 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1674 microversion: 2.1 time: 0.206609 Aug 30 01:17:23.454682 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 440/923] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:23 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1674 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:23.819794 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-fe65aefa-16e9-47e4-a4d1-a5747dc5d207 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:23.820491 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-fe65aefa-16e9-47e4-a4d1-a5747dc5d207 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:23.827043 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fe65aefa-16e9-47e4-a4d1-a5747dc5d207 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:23.827524 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fe65aefa-16e9-47e4-a4d1-a5747dc5d207 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:23.827963 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fe65aefa-16e9-47e4-a4d1-a5747dc5d207 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:23.828688 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fe65aefa-16e9-47e4-a4d1-a5747dc5d207 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:23.829109 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fe65aefa-16e9-47e4-a4d1-a5747dc5d207 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:23.829536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-fe65aefa-16e9-47e4-a4d1-a5747dc5d207 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:23.970149 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-fe65aefa-16e9-47e4-a4d1-a5747dc5d207 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:23.976989 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-fe65aefa-16e9-47e4-a4d1-a5747dc5d207 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:23.978485 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-fe65aefa-16e9-47e4-a4d1-a5747dc5d207 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:23.979680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-fe65aefa-16e9-47e4-a4d1-a5747dc5d207 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1737 microversion: 2.20 time: 0.164163 Aug 30 01:17:23.980247 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 484/924] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:23 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:24.476539 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-46635acb-df20-43cd-9c9b-0facf39880ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:24.477081 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-46635acb-df20-43cd-9c9b-0facf39880ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:24.483825 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46635acb-df20-43cd-9c9b-0facf39880ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:24.485794 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46635acb-df20-43cd-9c9b-0facf39880ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:24.485794 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46635acb-df20-43cd-9c9b-0facf39880ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:24.485794 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46635acb-df20-43cd-9c9b-0facf39880ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:24.486111 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46635acb-df20-43cd-9c9b-0facf39880ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:24.486378 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46635acb-df20-43cd-9c9b-0facf39880ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:24.631368 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-46635acb-df20-43cd-9c9b-0facf39880ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:24.639168 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-46635acb-df20-43cd-9c9b-0facf39880ae tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1674 microversion: 2.1 time: 0.166714 Aug 30 01:17:24.639850 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 441/925] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:24 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:25.003945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e94061bc-e4bd-4831-89e5-148130343ff7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:25.004638 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e94061bc-e4bd-4831-89e5-148130343ff7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:25.011696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e94061bc-e4bd-4831-89e5-148130343ff7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:25.012186 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e94061bc-e4bd-4831-89e5-148130343ff7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:25.012619 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e94061bc-e4bd-4831-89e5-148130343ff7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:25.013350 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e94061bc-e4bd-4831-89e5-148130343ff7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:25.013835 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e94061bc-e4bd-4831-89e5-148130343ff7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:25.014258 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e94061bc-e4bd-4831-89e5-148130343ff7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:25.154880 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e94061bc-e4bd-4831-89e5-148130343ff7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:25.164340 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e94061bc-e4bd-4831-89e5-148130343ff7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:25.166223 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e94061bc-e4bd-4831-89e5-148130343ff7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:25.167404 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e94061bc-e4bd-4831-89e5-148130343ff7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1737 microversion: 2.20 time: 0.168188 Aug 30 01:17:25.167972 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 485/926] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:24 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:25.661954 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9a7e8609-3b58-4002-81b8-1fd60b8be958 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:25.662637 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9a7e8609-3b58-4002-81b8-1fd60b8be958 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:25.669710 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a7e8609-3b58-4002-81b8-1fd60b8be958 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:25.670235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a7e8609-3b58-4002-81b8-1fd60b8be958 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:25.670682 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a7e8609-3b58-4002-81b8-1fd60b8be958 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:25.672175 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a7e8609-3b58-4002-81b8-1fd60b8be958 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:25.672723 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a7e8609-3b58-4002-81b8-1fd60b8be958 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:25.673156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a7e8609-3b58-4002-81b8-1fd60b8be958 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:25.888617 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9a7e8609-3b58-4002-81b8-1fd60b8be958 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:25.896940 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9a7e8609-3b58-4002-81b8-1fd60b8be958 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1674 microversion: 2.1 time: 0.239138 Aug 30 01:17:25.900741 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 442/927] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:25 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1674 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:26.191303 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-603a414a-2ea1-486d-934a-2e7f69525b65 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:26.192642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-603a414a-2ea1-486d-934a-2e7f69525b65 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:26.199405 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-603a414a-2ea1-486d-934a-2e7f69525b65 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:26.199845 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-603a414a-2ea1-486d-934a-2e7f69525b65 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:26.200287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-603a414a-2ea1-486d-934a-2e7f69525b65 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:26.201113 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-603a414a-2ea1-486d-934a-2e7f69525b65 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:26.201458 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-603a414a-2ea1-486d-934a-2e7f69525b65 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:26.202571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-603a414a-2ea1-486d-934a-2e7f69525b65 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:26.337858 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-603a414a-2ea1-486d-934a-2e7f69525b65 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:26.347826 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-603a414a-2ea1-486d-934a-2e7f69525b65 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:26.349495 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-603a414a-2ea1-486d-934a-2e7f69525b65 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:26.352449 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-603a414a-2ea1-486d-934a-2e7f69525b65 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1719 microversion: 2.20 time: 0.165159 Aug 30 01:17:26.353033 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 486/928] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:26 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:26.959605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-68210e50-31f7-4833-9b89-ca4f326db19a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:26.959605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-68210e50-31f7-4833-9b89-ca4f326db19a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:26.959605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68210e50-31f7-4833-9b89-ca4f326db19a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:26.959605 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68210e50-31f7-4833-9b89-ca4f326db19a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:26.960732 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68210e50-31f7-4833-9b89-ca4f326db19a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:26.960732 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68210e50-31f7-4833-9b89-ca4f326db19a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:26.960732 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68210e50-31f7-4833-9b89-ca4f326db19a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:26.960732 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68210e50-31f7-4833-9b89-ca4f326db19a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:27.029315 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-68210e50-31f7-4833-9b89-ca4f326db19a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:27.034433 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-68210e50-31f7-4833-9b89-ca4f326db19a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1607 microversion: 2.1 time: 0.120586 Aug 30 01:17:27.035029 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 443/929] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:26 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1607 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:27.207681 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-231de023-acc1-431e-826d-9194965574f7 req-f6ae7572-03b4-46c4-b4f2-586b321ea1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae3ba30-d38c-4e44-bc40-c9bda178d1b5", "name": "network-vif-deleted", "tag": "d73390a3-6a1a-4a0a-9fab-afc8d7d090e9"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:27.219767 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-231de023-acc1-431e-826d-9194965574f7 req-f6ae7572-03b4-46c4-b4f2-586b321ea1e4 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:27.220963 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-231de023-acc1-431e-826d-9194965574f7 req-f6ae7572-03b4-46c4-b4f2-586b321ea1e4 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:27.221402 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-231de023-acc1-431e-826d-9194965574f7 req-f6ae7572-03b4-46c4-b4f2-586b321ea1e4 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:27.232829 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-231de023-acc1-431e-826d-9194965574f7 req-f6ae7572-03b4-46c4-b4f2-586b321ea1e4 service nova] Creating event network-vif-deleted:d73390a3-6a1a-4a0a-9fab-afc8d7d090e9 for instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 on hv-cinder-81571 Aug 30 01:17:27.239479 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-231de023-acc1-431e-826d-9194965574f7 req-f6ae7572-03b4-46c4-b4f2-586b321ea1e4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036249 Aug 30 01:17:27.240086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 487/930] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:27.394234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e38b28c1-a9ea-4002-8a7b-b917d0f01a6e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:27.394846 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e38b28c1-a9ea-4002-8a7b-b917d0f01a6e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:27.400777 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e38b28c1-a9ea-4002-8a7b-b917d0f01a6e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:27.401259 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e38b28c1-a9ea-4002-8a7b-b917d0f01a6e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:27.408120 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e38b28c1-a9ea-4002-8a7b-b917d0f01a6e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:27.408120 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e38b28c1-a9ea-4002-8a7b-b917d0f01a6e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:27.408120 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e38b28c1-a9ea-4002-8a7b-b917d0f01a6e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:27.408120 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e38b28c1-a9ea-4002-8a7b-b917d0f01a6e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:27.562702 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e38b28c1-a9ea-4002-8a7b-b917d0f01a6e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:27.571429 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e38b28c1-a9ea-4002-8a7b-b917d0f01a6e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:27.572878 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e38b28c1-a9ea-4002-8a7b-b917d0f01a6e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:27.574139 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e38b28c1-a9ea-4002-8a7b-b917d0f01a6e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1719 microversion: 2.20 time: 0.184219 Aug 30 01:17:27.574770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 444/931] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:27 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1719 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:28.057514 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6847c44f-edb4-4d6f-94a7-6890836ce6f9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:28.058267 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6847c44f-edb4-4d6f-94a7-6890836ce6f9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:28.066289 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6847c44f-edb4-4d6f-94a7-6890836ce6f9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:28.066799 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6847c44f-edb4-4d6f-94a7-6890836ce6f9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:28.067242 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6847c44f-edb4-4d6f-94a7-6890836ce6f9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:28.068377 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6847c44f-edb4-4d6f-94a7-6890836ce6f9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:28.068606 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6847c44f-edb4-4d6f-94a7-6890836ce6f9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:28.069054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6847c44f-edb4-4d6f-94a7-6890836ce6f9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:28.137390 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6847c44f-edb4-4d6f-94a7-6890836ce6f9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:28.146166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6847c44f-edb4-4d6f-94a7-6890836ce6f9 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1607 microversion: 2.1 time: 0.093015 Aug 30 01:17:28.146797 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 488/932] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:28 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1607 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:28.596770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-272b7626-f297-4040-a06a-10e728ee1aa4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:28.597423 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-272b7626-f297-4040-a06a-10e728ee1aa4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:28.603910 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-272b7626-f297-4040-a06a-10e728ee1aa4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:28.604396 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-272b7626-f297-4040-a06a-10e728ee1aa4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:28.604856 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-272b7626-f297-4040-a06a-10e728ee1aa4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:28.605533 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-272b7626-f297-4040-a06a-10e728ee1aa4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:28.606012 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-272b7626-f297-4040-a06a-10e728ee1aa4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:28.608779 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-272b7626-f297-4040-a06a-10e728ee1aa4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:28.760197 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-272b7626-f297-4040-a06a-10e728ee1aa4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:28.762905 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-5b4ed42a-5332-4a31-9095-e7a4230e1385 req-27c97096-b2bf-430a-9e73-4cae8583f0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b743eb-1b3f-458d-ad48-d60c3934ba0d", "name": "network-vif-unplugged", "status": "completed", "tag": "adb8f445-f2e5-41a5-91ba-43406b91be88"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:28.769831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-272b7626-f297-4040-a06a-10e728ee1aa4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:28.771540 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-272b7626-f297-4040-a06a-10e728ee1aa4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:28.774897 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-272b7626-f297-4040-a06a-10e728ee1aa4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1719 microversion: 2.20 time: 0.180103 Aug 30 01:17:28.774897 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 445/933] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:28 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:17:28.775116 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-5b4ed42a-5332-4a31-9095-e7a4230e1385 req-27c97096-b2bf-430a-9e73-4cae8583f0e7 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:28.775116 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-5b4ed42a-5332-4a31-9095-e7a4230e1385 req-27c97096-b2bf-430a-9e73-4cae8583f0e7 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:28.775116 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-5b4ed42a-5332-4a31-9095-e7a4230e1385 req-27c97096-b2bf-430a-9e73-4cae8583f0e7 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:28.786318 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-5b4ed42a-5332-4a31-9095-e7a4230e1385 req-27c97096-b2bf-430a-9e73-4cae8583f0e7 service nova] Creating event network-vif-unplugged:adb8f445-f2e5-41a5-91ba-43406b91be88 for instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d on hv-cinder-81571 Aug 30 01:17:28.791462 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-5b4ed42a-5332-4a31-9095-e7a4230e1385 req-27c97096-b2bf-430a-9e73-4cae8583f0e7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033451 Aug 30 01:17:28.792024 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 489/934] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:29.167109 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cfe2afd3-e985-4e9c-9411-4867797df47a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:29.167715 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cfe2afd3-e985-4e9c-9411-4867797df47a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:29.174718 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cfe2afd3-e985-4e9c-9411-4867797df47a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:29.175161 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cfe2afd3-e985-4e9c-9411-4867797df47a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:29.175599 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cfe2afd3-e985-4e9c-9411-4867797df47a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:29.176320 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cfe2afd3-e985-4e9c-9411-4867797df47a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:29.176774 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cfe2afd3-e985-4e9c-9411-4867797df47a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:29.177194 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cfe2afd3-e985-4e9c-9411-4867797df47a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:29.210946 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cfe2afd3-e985-4e9c-9411-4867797df47a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:29.211427 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cfe2afd3-e985-4e9c-9411-4867797df47a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:29.211858 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cfe2afd3-e985-4e9c-9411-4867797df47a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:29.212296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-cfe2afd3-e985-4e9c-9411-4867797df47a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lazy-loading 'fault' on Instance uuid 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:17:29.257227 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cfe2afd3-e985-4e9c-9411-4867797df47a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90486e175bb2411b9f2adedf6e3ecac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13862ab3a9504644853a8c48c3f69b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:29.265266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cfe2afd3-e985-4e9c-9411-4867797df47a tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 200 len: 1328 microversion: 2.1 time: 0.102344 Aug 30 01:17:29.265966 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 446/935] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:29 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:29.797580 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-24183d04-46ef-4584-99b1-316131b03df0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:29.798313 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-24183d04-46ef-4584-99b1-316131b03df0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:29.804726 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-24183d04-46ef-4584-99b1-316131b03df0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:29.805216 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-24183d04-46ef-4584-99b1-316131b03df0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:29.805657 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-24183d04-46ef-4584-99b1-316131b03df0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:29.806401 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-24183d04-46ef-4584-99b1-316131b03df0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:29.806856 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-24183d04-46ef-4584-99b1-316131b03df0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:29.807288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-24183d04-46ef-4584-99b1-316131b03df0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:29.949841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-24183d04-46ef-4584-99b1-316131b03df0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:29.956807 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-24183d04-46ef-4584-99b1-316131b03df0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:29.958292 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-24183d04-46ef-4584-99b1-316131b03df0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:29.959465 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-24183d04-46ef-4584-99b1-316131b03df0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1722 microversion: 2.20 time: 0.166976 Aug 30 01:17:29.960026 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 490/936] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:29 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:29.986366 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0ec670c7-c372-438b-94af-17ef631af8ef tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c61ddd75-fea3-41d9-9f90-96eee3b45d72"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:29.988917 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0ec670c7-c372-438b-94af-17ef631af8ef tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:29.995795 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ec670c7-c372-438b-94af-17ef631af8ef tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:29.996276 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ec670c7-c372-438b-94af-17ef631af8ef tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:29.996716 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ec670c7-c372-438b-94af-17ef631af8ef tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:29.997452 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ec670c7-c372-438b-94af-17ef631af8ef tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:29.997943 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ec670c7-c372-438b-94af-17ef631af8ef tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:29.998427 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ec670c7-c372-438b-94af-17ef631af8ef tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:30.291808 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2095c5ca-4ef5-470b-86b3-171121eca92f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:30.296783 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2095c5ca-4ef5-470b-86b3-171121eca92f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:30.303234 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2095c5ca-4ef5-470b-86b3-171121eca92f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:30.303736 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2095c5ca-4ef5-470b-86b3-171121eca92f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:30.304177 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2095c5ca-4ef5-470b-86b3-171121eca92f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:30.304901 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2095c5ca-4ef5-470b-86b3-171121eca92f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:30.305362 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2095c5ca-4ef5-470b-86b3-171121eca92f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:30.305812 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2095c5ca-4ef5-470b-86b3-171121eca92f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:30.322458 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-2095c5ca-4ef5-470b-86b3-171121eca92f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] HTTP exception thrown: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2095c5ca-4ef5-470b-86b3-171121eca92f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Request method failure captured: Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 HTTP/1.1 Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOcY192hneaWv-NPReFMbYw7mU-VvzMV4_D8OFt35mri1iXgTodRsBg3a-C_Pird-5DpPlRFWa6OmVdM4njhoSGrx83O5C7kcFrFakQQHMcnSw7dVa3PjBXf3eUyNKoq4T-0ymcTlQ6Ixftps3Fn1F8AaLwMtc9RDKX_4g86-ep5ck Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 13862ab3a9504644853a8c48c3f69b4c Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:17:30.324182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:17:30.329041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:17:30.329041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:17:30.329041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 13862ab3a9504644853a8c48c3f69b4c Aug 30 01:17:30.329041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:17:30.329041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-AttachVolumeTestJSON-1554932294-project Aug 30 01:17:30.329041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:17:30.329041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:17:30.329041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 90486e175bb2411b9f2adedf6e3ecac6 Aug 30 01:17:30.329041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-AttachVolumeTestJSON-1554932294-project Aug 30 01:17:30.329041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:17:30.329041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. Aug 30 01:17:30.329041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': '7ae3ba30-d38c-4e44-bc40-c9bda178d1b5'} Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:17:30.330050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. Aug 30 01:17:30.331680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:30.333108 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2095c5ca-4ef5-470b-86b3-171121eca92f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Returning 404 to user: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:17:30.333108 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2095c5ca-4ef5-470b-86b3-171121eca92f tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 404 len: 111 microversion: 2.1 time: 0.037997 Aug 30 01:17:30.333108 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 491/937] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:30 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:17:30.334439 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b3c2b55a-76ca-4953-8310-afa18ff671e3 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '.version_select at 0x7fd71d0050d0>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:30.449870 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-b3c2b55a-76ca-4953-8310-afa18ff671e3 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609292028" status: 202 len: 0 microversion: 2.1 time: 0.118867 Aug 30 01:17:30.450349 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 492/938] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Aug 30 01:17:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609292028 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:17:30.635746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=4,nova_cell1:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:31.177716 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0ec670c7-c372-438b-94af-17ef631af8ef tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "POST /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.195298 Aug 30 01:17:31.178365 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 447/939] 10.222.0.52 () {62 vars in 1364 bytes} [Tue Aug 30 01:17:29 2022] POST /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d/os-volume_attachments => generated 188 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:17:31.319670 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f0748309-fccc-4085-96c6-eff93c09d760 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:31.325021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f0748309-fccc-4085-96c6-eff93c09d760 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:31.328685 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0748309-fccc-4085-96c6-eff93c09d760 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:31.329179 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0748309-fccc-4085-96c6-eff93c09d760 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:31.329621 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0748309-fccc-4085-96c6-eff93c09d760 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:31.330350 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0748309-fccc-4085-96c6-eff93c09d760 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:31.330813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0748309-fccc-4085-96c6-eff93c09d760 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:31.331249 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0748309-fccc-4085-96c6-eff93c09d760 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:32.079816 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f0748309-fccc-4085-96c6-eff93c09d760 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "DELETE /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d/os-volume_attachments/c61ddd75-fea3-41d9-9f90-96eee3b45d72" status: 202 len: 0 microversion: 2.20 time: 0.764583 Aug 30 01:17:32.080419 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 493/940] 10.222.0.52 () {60 vars in 1457 bytes} [Tue Aug 30 01:17:31 2022] DELETE /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d/os-volume_attachments/c61ddd75-fea3-41d9-9f90-96eee3b45d72 => generated 0 bytes in 766 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:17:32.141887 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d69cafe3-8ef3-45c4-8c69-54ceff5d7a17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:32.142489 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d69cafe3-8ef3-45c4-8c69-54ceff5d7a17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:32.149717 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d69cafe3-8ef3-45c4-8c69-54ceff5d7a17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:32.150232 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d69cafe3-8ef3-45c4-8c69-54ceff5d7a17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:32.152049 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d69cafe3-8ef3-45c4-8c69-54ceff5d7a17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:32.152049 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d69cafe3-8ef3-45c4-8c69-54ceff5d7a17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:32.152049 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d69cafe3-8ef3-45c4-8c69-54ceff5d7a17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:32.152351 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d69cafe3-8ef3-45c4-8c69-54ceff5d7a17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:32.201688 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d69cafe3-8ef3-45c4-8c69-54ceff5d7a17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121232) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 01:17:32.572261 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d69cafe3-8ef3-45c4-8c69-54ceff5d7a17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "POST /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d/action" status: 202 len: 0 microversion: 2.20 time: 0.435190 Aug 30 01:17:32.572989 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 448/941] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Aug 30 01:17:32 2022] POST /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:17:32.581215 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-13ce57f6-41c2-4404-af8b-cf654ce2dd9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:32.581697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-13ce57f6-41c2-4404-af8b-cf654ce2dd9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:32.593619 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13ce57f6-41c2-4404-af8b-cf654ce2dd9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:32.594508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13ce57f6-41c2-4404-af8b-cf654ce2dd9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:32.595388 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13ce57f6-41c2-4404-af8b-cf654ce2dd9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:32.596144 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13ce57f6-41c2-4404-af8b-cf654ce2dd9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:32.596605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13ce57f6-41c2-4404-af8b-cf654ce2dd9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:32.597124 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13ce57f6-41c2-4404-af8b-cf654ce2dd9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:32.733001 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-13ce57f6-41c2-4404-af8b-cf654ce2dd9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:32.742611 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-13ce57f6-41c2-4404-af8b-cf654ce2dd9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:32.744095 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-13ce57f6-41c2-4404-af8b-cf654ce2dd9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:32.745277 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-13ce57f6-41c2-4404-af8b-cf654ce2dd9d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1670 microversion: 2.20 time: 0.168204 Aug 30 01:17:32.745853 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 494/942] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:32 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:33.770110 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-99ca9052-915d-4b61-8c56-192ac63de2e0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:33.770793 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-99ca9052-915d-4b61-8c56-192ac63de2e0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:33.776676 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99ca9052-915d-4b61-8c56-192ac63de2e0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:33.777160 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99ca9052-915d-4b61-8c56-192ac63de2e0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:33.777594 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99ca9052-915d-4b61-8c56-192ac63de2e0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:33.778319 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99ca9052-915d-4b61-8c56-192ac63de2e0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:33.778774 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99ca9052-915d-4b61-8c56-192ac63de2e0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:33.779197 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99ca9052-915d-4b61-8c56-192ac63de2e0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:33.913317 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-99ca9052-915d-4b61-8c56-192ac63de2e0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:33.923317 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-99ca9052-915d-4b61-8c56-192ac63de2e0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:33.927852 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-99ca9052-915d-4b61-8c56-192ac63de2e0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:33.929619 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-99ca9052-915d-4b61-8c56-192ac63de2e0 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1670 microversion: 2.20 time: 0.164831 Aug 30 01:17:33.935639 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 449/943] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:33 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:33.939284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-360a8841-74f1-41d7-a785-d127cfb891c1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:33.939860 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-360a8841-74f1-41d7-a785-d127cfb891c1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:33.946696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-360a8841-74f1-41d7-a785-d127cfb891c1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:33.947186 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-360a8841-74f1-41d7-a785-d127cfb891c1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:33.947626 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-360a8841-74f1-41d7-a785-d127cfb891c1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:33.948629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-360a8841-74f1-41d7-a785-d127cfb891c1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:33.949097 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-360a8841-74f1-41d7-a785-d127cfb891c1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:33.949525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-360a8841-74f1-41d7-a785-d127cfb891c1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:33.964725 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-360a8841-74f1-41d7-a785-d127cfb891c1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] HTTP exception thrown: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-360a8841-74f1-41d7-a785-d127cfb891c1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Request method failure captured: Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: DELETE /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 HTTP/1.1 Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOcY192hneaWv-NPReFMbYw7mU-VvzMV4_D8OFt35mri1iXgTodRsBg3a-C_Pird-5DpPlRFWa6OmVdM4njhoSGrx83O5C7kcFrFakQQHMcnSw7dVa3PjBXf3eUyNKoq4T-0ymcTlQ6Ixftps3Fn1F8AaLwMtc9RDKX_4g86-ep5ck Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 13862ab3a9504644853a8c48c3f69b4c Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:17:33.966315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:17:33.967669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:17:33.967669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:17:33.967669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 13862ab3a9504644853a8c48c3f69b4c Aug 30 01:17:33.967669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:17:33.967669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-AttachVolumeTestJSON-1554932294-project Aug 30 01:17:33.967669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:17:33.967669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:17:33.967669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 90486e175bb2411b9f2adedf6e3ecac6 Aug 30 01:17:33.967669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-AttachVolumeTestJSON-1554932294-project Aug 30 01:17:33.967669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:17:33.967669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. Aug 30 01:17:33.967669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': '7ae3ba30-d38c-4e44-bc40-c9bda178d1b5'} Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:17:33.972287 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. Aug 30 01:17:33.974093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:33.975571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-360a8841-74f1-41d7-a785-d127cfb891c1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Returning 404 to user: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:17:33.975571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-360a8841-74f1-41d7-a785-d127cfb891c1 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 404 len: 111 microversion: 2.1 time: 0.035438 Aug 30 01:17:33.975571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 495/944] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:17:33 2022] DELETE /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:17:33.976607 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-48e50ee8-0995-42dc-908b-f70840f78266 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:33.977226 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-48e50ee8-0995-42dc-908b-f70840f78266 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:33.984298 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48e50ee8-0995-42dc-908b-f70840f78266 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:33.984784 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48e50ee8-0995-42dc-908b-f70840f78266 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:33.985488 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48e50ee8-0995-42dc-908b-f70840f78266 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:33.986344 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48e50ee8-0995-42dc-908b-f70840f78266 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:33.986987 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48e50ee8-0995-42dc-908b-f70840f78266 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:33.987482 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48e50ee8-0995-42dc-908b-f70840f78266 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:34.002064 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-48e50ee8-0995-42dc-908b-f70840f78266 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] HTTP exception thrown: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-48e50ee8-0995-42dc-908b-f70840f78266 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Request method failure captured: Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 HTTP/1.1 Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWOcY192hneaWv-NPReFMbYw7mU-VvzMV4_D8OFt35mri1iXgTodRsBg3a-C_Pird-5DpPlRFWa6OmVdM4njhoSGrx83O5C7kcFrFakQQHMcnSw7dVa3PjBXf3eUyNKoq4T-0ymcTlQ6Ixftps3Fn1F8AaLwMtc9RDKX_4g86-ep5ck Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 13862ab3a9504644853a8c48c3f69b4c Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:17:34.003781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:17:34.010328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:17:34.010328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:17:34.010328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 13862ab3a9504644853a8c48c3f69b4c Aug 30 01:17:34.010328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:17:34.010328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeTestJSON-1554932294-project Aug 30 01:17:34.010328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:17:34.010328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:17:34.010328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 90486e175bb2411b9f2adedf6e3ecac6 Aug 30 01:17:34.010328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeTestJSON-1554932294-project Aug 30 01:17:34.010328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:17:34.010328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. Aug 30 01:17:34.010328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': '7ae3ba30-d38c-4e44-bc40-c9bda178d1b5'} Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:17:34.011234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. Aug 30 01:17:34.012696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:17:34.013979 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-48e50ee8-0995-42dc-908b-f70840f78266 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Returning 404 to user: Instance 7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:17:34.013979 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-48e50ee8-0995-42dc-908b-f70840f78266 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5" status: 404 len: 111 microversion: 2.1 time: 0.032380 Aug 30 01:17:34.013979 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 450/945] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:33 2022] GET /compute/v2.1/servers/7ae3ba30-d38c-4e44-bc40-c9bda178d1b5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:17:34.954142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-25fd2181-968e-44c1-ba45-75c39bcad030 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:34.958045 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-25fd2181-968e-44c1-ba45-75c39bcad030 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:34.962194 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25fd2181-968e-44c1-ba45-75c39bcad030 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:34.962407 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25fd2181-968e-44c1-ba45-75c39bcad030 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:34.962962 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25fd2181-968e-44c1-ba45-75c39bcad030 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:34.963772 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25fd2181-968e-44c1-ba45-75c39bcad030 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:34.964226 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25fd2181-968e-44c1-ba45-75c39bcad030 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:34.964644 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-25fd2181-968e-44c1-ba45-75c39bcad030 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:35.104096 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-25fd2181-968e-44c1-ba45-75c39bcad030 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:35.112912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-25fd2181-968e-44c1-ba45-75c39bcad030 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:35.114366 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-25fd2181-968e-44c1-ba45-75c39bcad030 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:35.115511 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-25fd2181-968e-44c1-ba45-75c39bcad030 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.165908 Aug 30 01:17:35.119337 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 496/946] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:34 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:35.370522 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bc631fc7-4699-4ff1-919a-9d35a3e7d829 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:35.370987 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bc631fc7-4699-4ff1-919a-9d35a3e7d829 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:35.378770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc631fc7-4699-4ff1-919a-9d35a3e7d829 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:35.379328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc631fc7-4699-4ff1-919a-9d35a3e7d829 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:35.379775 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc631fc7-4699-4ff1-919a-9d35a3e7d829 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:35.380496 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc631fc7-4699-4ff1-919a-9d35a3e7d829 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:35.380935 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc631fc7-4699-4ff1-919a-9d35a3e7d829 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:35.381554 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc631fc7-4699-4ff1-919a-9d35a3e7d829 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:35.396849 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-bc631fc7-4699-4ff1-919a-9d35a3e7d829 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] HTTP exception thrown: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bc631fc7-4699-4ff1-919a-9d35a3e7d829 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Request method failure captured: Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 HTTP/1.1 Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWOcY192hneaWv-NPReFMbYw7mU-VvzMV4_D8OFt35mri1iXgTodRsBg3a-C_Pird-5DpPlRFWa6OmVdM4njhoSGrx83O5C7kcFrFakQQHMcnSw7dVa3PjBXf3eUyNKoq4T-0ymcTlQ6Ixftps3Fn1F8AaLwMtc9RDKX_4g86-ep5ck Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 13862ab3a9504644853a8c48c3f69b4c Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:17:35.398458 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:17:35.400080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:17:35.400080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:17:35.400080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 13862ab3a9504644853a8c48c3f69b4c Aug 30 01:17:35.400080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:17:35.400080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeTestJSON-1554932294-project Aug 30 01:17:35.400080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:17:35.400080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:17:35.400080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 90486e175bb2411b9f2adedf6e3ecac6 Aug 30 01:17:35.400080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeTestJSON-1554932294-project Aug 30 01:17:35.400080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:17:35.400080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. Aug 30 01:17:35.400080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': '5022a2c4-6b00-416c-9a13-63b0dec702b2'} Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:17:35.400885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. Aug 30 01:17:35.402312 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:17:35.403664 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bc631fc7-4699-4ff1-919a-9d35a3e7d829 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Returning 404 to user: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:17:35.403664 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bc631fc7-4699-4ff1-919a-9d35a3e7d829 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 404 len: 111 microversion: 2.1 time: 0.033197 Aug 30 01:17:35.403664 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 451/947] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:17:35 2022] DELETE /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:17:35.409214 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-73869f62-1a97-4645-ace7-cfefe57a6981 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:35.411268 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-73869f62-1a97-4645-ace7-cfefe57a6981 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] [instance: 5022a2c4-6b00-416c-9a13-63b0dec702b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:35.416510 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-73869f62-1a97-4645-ace7-cfefe57a6981 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:35.417246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-73869f62-1a97-4645-ace7-cfefe57a6981 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:35.417705 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-73869f62-1a97-4645-ace7-cfefe57a6981 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:35.418427 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-73869f62-1a97-4645-ace7-cfefe57a6981 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:35.418910 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-73869f62-1a97-4645-ace7-cfefe57a6981 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:35.419343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-73869f62-1a97-4645-ace7-cfefe57a6981 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:35.433517 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-73869f62-1a97-4645-ace7-cfefe57a6981 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] HTTP exception thrown: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-73869f62-1a97-4645-ace7-cfefe57a6981 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Request method failure captured: Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 HTTP/1.1 Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOcY192hneaWv-NPReFMbYw7mU-VvzMV4_D8OFt35mri1iXgTodRsBg3a-C_Pird-5DpPlRFWa6OmVdM4njhoSGrx83O5C7kcFrFakQQHMcnSw7dVa3PjBXf3eUyNKoq4T-0ymcTlQ6Ixftps3Fn1F8AaLwMtc9RDKX_4g86-ep5ck Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 13862ab3a9504644853a8c48c3f69b4c Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:17:35.435143 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:17:35.437256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13862ab3a9504644853a8c48c3f69b4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:17:35.437256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:17:35.437256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 13862ab3a9504644853a8c48c3f69b4c Aug 30 01:17:35.437256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1554932294 Aug 30 01:17:35.437256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-AttachVolumeTestJSON-1554932294-project Aug 30 01:17:35.437256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:17:35.437256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:17:35.437256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 90486e175bb2411b9f2adedf6e3ecac6 Aug 30 01:17:35.437256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-AttachVolumeTestJSON-1554932294-project Aug 30 01:17:35.437256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:17:35.437256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. Aug 30 01:17:35.437256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': '5022a2c4-6b00-416c-9a13-63b0dec702b2'} Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:17:35.438279 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. Aug 30 01:17:35.439587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:35.440822 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-73869f62-1a97-4645-ace7-cfefe57a6981 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] Returning 404 to user: Instance 5022a2c4-6b00-416c-9a13-63b0dec702b2 could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:17:35.440822 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-73869f62-1a97-4645-ace7-cfefe57a6981 tempest-AttachVolumeTestJSON-1554932294 tempest-AttachVolumeTestJSON-1554932294-project] 10.222.0.52 "GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2" status: 404 len: 111 microversion: 2.1 time: 0.031770 Aug 30 01:17:35.440822 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 497/948] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:35 2022] GET /compute/v2.1/servers/5022a2c4-6b00-416c-9a13-63b0dec702b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:17:36.138446 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0c5c17e3-1535-451f-b030-b572b468d5b6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:36.139050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0c5c17e3-1535-451f-b030-b572b468d5b6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:36.146136 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c5c17e3-1535-451f-b030-b572b468d5b6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:36.146614 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c5c17e3-1535-451f-b030-b572b468d5b6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:36.147059 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c5c17e3-1535-451f-b030-b572b468d5b6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:36.147768 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c5c17e3-1535-451f-b030-b572b468d5b6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:36.148246 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c5c17e3-1535-451f-b030-b572b468d5b6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:36.148673 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c5c17e3-1535-451f-b030-b572b468d5b6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:36.632311 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0c5c17e3-1535-451f-b030-b572b468d5b6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:36.644622 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0c5c17e3-1535-451f-b030-b572b468d5b6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:36.647325 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0c5c17e3-1535-451f-b030-b572b468d5b6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:36.648832 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0c5c17e3-1535-451f-b030-b572b468d5b6 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.514480 Aug 30 01:17:36.662298 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 452/949] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:36 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:37.676362 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-889cfc93-f47f-41fe-8c26-2f429344d008 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:37.677801 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-889cfc93-f47f-41fe-8c26-2f429344d008 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:37.692621 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-889cfc93-f47f-41fe-8c26-2f429344d008 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:37.693667 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-889cfc93-f47f-41fe-8c26-2f429344d008 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:37.694875 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-889cfc93-f47f-41fe-8c26-2f429344d008 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:37.696111 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-889cfc93-f47f-41fe-8c26-2f429344d008 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:37.696921 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-889cfc93-f47f-41fe-8c26-2f429344d008 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:37.697642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-889cfc93-f47f-41fe-8c26-2f429344d008 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:37.764875 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:37.960009 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-889cfc93-f47f-41fe-8c26-2f429344d008 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:37.997965 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-889cfc93-f47f-41fe-8c26-2f429344d008 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:38.009646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-889cfc93-f47f-41fe-8c26-2f429344d008 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:38.016613 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-889cfc93-f47f-41fe-8c26-2f429344d008 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.346308 Aug 30 01:17:38.019230 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 498/950] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:37 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:39.047954 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b8574223-2838-4f89-8f01-6fa772cefe64 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:39.049464 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b8574223-2838-4f89-8f01-6fa772cefe64 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:39.070138 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b8574223-2838-4f89-8f01-6fa772cefe64 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:39.071597 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b8574223-2838-4f89-8f01-6fa772cefe64 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:39.074205 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b8574223-2838-4f89-8f01-6fa772cefe64 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:39.075773 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b8574223-2838-4f89-8f01-6fa772cefe64 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:39.076310 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b8574223-2838-4f89-8f01-6fa772cefe64 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:39.078002 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b8574223-2838-4f89-8f01-6fa772cefe64 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:39.475767 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b8574223-2838-4f89-8f01-6fa772cefe64 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:39.491295 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b8574223-2838-4f89-8f01-6fa772cefe64 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:39.493214 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b8574223-2838-4f89-8f01-6fa772cefe64 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:39.501871 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b8574223-2838-4f89-8f01-6fa772cefe64 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.459448 Aug 30 01:17:39.502771 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 453/951] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:39 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:40.528128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2ec25b04-8560-4434-a2a8-f31bbeb026b8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:40.529072 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2ec25b04-8560-4434-a2a8-f31bbeb026b8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:40.554270 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ec25b04-8560-4434-a2a8-f31bbeb026b8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:40.556130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ec25b04-8560-4434-a2a8-f31bbeb026b8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:40.556591 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ec25b04-8560-4434-a2a8-f31bbeb026b8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:40.557518 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ec25b04-8560-4434-a2a8-f31bbeb026b8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:40.561204 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ec25b04-8560-4434-a2a8-f31bbeb026b8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:40.566602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2ec25b04-8560-4434-a2a8-f31bbeb026b8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:40.885911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2ec25b04-8560-4434-a2a8-f31bbeb026b8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:40.911519 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2ec25b04-8560-4434-a2a8-f31bbeb026b8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:40.914750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2ec25b04-8560-4434-a2a8-f31bbeb026b8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:40.916779 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2ec25b04-8560-4434-a2a8-f31bbeb026b8 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.393808 Aug 30 01:17:40.917818 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 499/952] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:40 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:41.946327 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-23da9947-c931-4f48-b8d8-3047e4259b0f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:41.947925 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-23da9947-c931-4f48-b8d8-3047e4259b0f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:41.954179 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23da9947-c931-4f48-b8d8-3047e4259b0f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:41.954670 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23da9947-c931-4f48-b8d8-3047e4259b0f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:41.955298 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23da9947-c931-4f48-b8d8-3047e4259b0f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:41.956014 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23da9947-c931-4f48-b8d8-3047e4259b0f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:41.956462 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23da9947-c931-4f48-b8d8-3047e4259b0f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:41.957043 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-23da9947-c931-4f48-b8d8-3047e4259b0f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:42.114525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-23da9947-c931-4f48-b8d8-3047e4259b0f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:42.124870 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-23da9947-c931-4f48-b8d8-3047e4259b0f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:42.126513 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-23da9947-c931-4f48-b8d8-3047e4259b0f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:42.127972 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-23da9947-c931-4f48-b8d8-3047e4259b0f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.185919 Aug 30 01:17:42.128733 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 454/953] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:41 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:43.151319 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-cc352f92-0067-4690-9d57-8042f512a262 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:43.152256 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-cc352f92-0067-4690-9d57-8042f512a262 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:43.162167 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc352f92-0067-4690-9d57-8042f512a262 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:43.162577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc352f92-0067-4690-9d57-8042f512a262 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:43.163231 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc352f92-0067-4690-9d57-8042f512a262 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:43.163954 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc352f92-0067-4690-9d57-8042f512a262 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:43.164679 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc352f92-0067-4690-9d57-8042f512a262 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:43.165112 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-cc352f92-0067-4690-9d57-8042f512a262 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:43.330390 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-cc352f92-0067-4690-9d57-8042f512a262 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:43.340522 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-cc352f92-0067-4690-9d57-8042f512a262 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:43.342625 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-cc352f92-0067-4690-9d57-8042f512a262 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:43.344775 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-cc352f92-0067-4690-9d57-8042f512a262 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.197433 Aug 30 01:17:43.346530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 500/954] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:43 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:44.368681 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5717fbcf-7d63-4a9f-a5c9-09948cf2ff82 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:44.370211 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5717fbcf-7d63-4a9f-a5c9-09948cf2ff82 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:44.375805 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5717fbcf-7d63-4a9f-a5c9-09948cf2ff82 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:44.376513 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5717fbcf-7d63-4a9f-a5c9-09948cf2ff82 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:44.377184 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5717fbcf-7d63-4a9f-a5c9-09948cf2ff82 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:44.378091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5717fbcf-7d63-4a9f-a5c9-09948cf2ff82 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:44.378736 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5717fbcf-7d63-4a9f-a5c9-09948cf2ff82 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:44.379324 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5717fbcf-7d63-4a9f-a5c9-09948cf2ff82 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:44.531175 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5717fbcf-7d63-4a9f-a5c9-09948cf2ff82 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:44.540642 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5717fbcf-7d63-4a9f-a5c9-09948cf2ff82 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:44.542218 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5717fbcf-7d63-4a9f-a5c9-09948cf2ff82 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:44.543321 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5717fbcf-7d63-4a9f-a5c9-09948cf2ff82 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.178657 Aug 30 01:17:44.544074 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 455/955] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:44 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:44.632788 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-13396967-79af-4c89-9984-e75cda101532 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1421496511"}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:44.633333 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-13396967-79af-4c89-9984-e75cda101532 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:44.641674 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13396967-79af-4c89-9984-e75cda101532 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:44.642567 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13396967-79af-4c89-9984-e75cda101532 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:44.643237 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13396967-79af-4c89-9984-e75cda101532 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:44.646396 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13396967-79af-4c89-9984-e75cda101532 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:44.647317 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13396967-79af-4c89-9984-e75cda101532 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:44.647981 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-13396967-79af-4c89-9984-e75cda101532 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:44.816975 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.network.security_group_api [None req-13396967-79af-4c89-9984-e75cda101532 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Removing security group 3c05186b-c954-426b-bdda-89534f7db01a from port fb9f85b8-7682-4117-938b-7225f55cd3b2 Aug 30 01:17:45.458815 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-13396967-79af-4c89-9984-e75cda101532 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "POST /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/action" status: 202 len: 0 microversion: 2.1 time: 0.829741 Aug 30 01:17:45.459823 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 501/956] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 30 01:17:44 2022] POST /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/action => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:17:45.499868 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-5ebc9d56-c065-4e2b-bfa9-8b53d59cb55d req-9c44f5f3-c088-4a5e-b605-d420601f4356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfb98683-87f8-47ff-89d6-4d74e9f961d1", "tag": "fb9f85b8-7682-4117-938b-7225f55cd3b2"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:45.523157 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-5ebc9d56-c065-4e2b-bfa9-8b53d59cb55d req-9c44f5f3-c088-4a5e-b605-d420601f4356 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:45.523632 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-5ebc9d56-c065-4e2b-bfa9-8b53d59cb55d req-9c44f5f3-c088-4a5e-b605-d420601f4356 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:45.531016 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-5ebc9d56-c065-4e2b-bfa9-8b53d59cb55d req-9c44f5f3-c088-4a5e-b605-d420601f4356 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:45.538777 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-5ebc9d56-c065-4e2b-bfa9-8b53d59cb55d req-9c44f5f3-c088-4a5e-b605-d420601f4356 service nova] Creating event network-changed:fb9f85b8-7682-4117-938b-7225f55cd3b2 for instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 on hv-cinder-81571 Aug 30 01:17:45.545178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-5ebc9d56-c065-4e2b-bfa9-8b53d59cb55d req-9c44f5f3-c088-4a5e-b605-d420601f4356 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049724 Aug 30 01:17:45.546781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 456/957] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:45.567897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6f862952-3e2d-4efc-bba0-b9c7fcf4c7a5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:45.568669 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6f862952-3e2d-4efc-bba0-b9c7fcf4c7a5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:45.580746 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6f862952-3e2d-4efc-bba0-b9c7fcf4c7a5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:45.581238 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6f862952-3e2d-4efc-bba0-b9c7fcf4c7a5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:45.583983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6f862952-3e2d-4efc-bba0-b9c7fcf4c7a5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:45.588458 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6f862952-3e2d-4efc-bba0-b9c7fcf4c7a5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:45.588458 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6f862952-3e2d-4efc-bba0-b9c7fcf4c7a5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:45.588458 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6f862952-3e2d-4efc-bba0-b9c7fcf4c7a5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:45.915264 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6f862952-3e2d-4efc-bba0-b9c7fcf4c7a5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:45.925115 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6f862952-3e2d-4efc-bba0-b9c7fcf4c7a5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:45.926918 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6f862952-3e2d-4efc-bba0-b9c7fcf4c7a5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:45.945254 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6f862952-3e2d-4efc-bba0-b9c7fcf4c7a5 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.365250 Aug 30 01:17:45.945254 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 502/958] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:45 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:46.956549 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-267b7dbd-aa21-48ff-abdf-564beb0c33d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:46.957241 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-267b7dbd-aa21-48ff-abdf-564beb0c33d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:46.964173 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-267b7dbd-aa21-48ff-abdf-564beb0c33d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:46.964662 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-267b7dbd-aa21-48ff-abdf-564beb0c33d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:46.965333 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-267b7dbd-aa21-48ff-abdf-564beb0c33d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:46.965976 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-267b7dbd-aa21-48ff-abdf-564beb0c33d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:46.966442 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-267b7dbd-aa21-48ff-abdf-564beb0c33d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:46.967189 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-267b7dbd-aa21-48ff-abdf-564beb0c33d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:47.214272 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-267b7dbd-aa21-48ff-abdf-564beb0c33d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:47.223493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-267b7dbd-aa21-48ff-abdf-564beb0c33d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:47.225021 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-267b7dbd-aa21-48ff-abdf-564beb0c33d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:47.226226 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-267b7dbd-aa21-48ff-abdf-564beb0c33d2 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.275128 Aug 30 01:17:47.226791 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 457/959] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:46 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:17:47.515712 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6c8421ba-057e-4edd-8da5-4fa0cd785f5b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:47.516607 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6c8421ba-057e-4edd-8da5-4fa0cd785f5b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:47.526749 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-d28e565e-f217-4c9c-9809-21ecb4162538 req-ab399315-a10a-449a-bee4-4ef3dbe599a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfb98683-87f8-47ff-89d6-4d74e9f961d1", "tag": "fb9f85b8-7682-4117-938b-7225f55cd3b2"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:47.526919 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c8421ba-057e-4edd-8da5-4fa0cd785f5b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:47.526919 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c8421ba-057e-4edd-8da5-4fa0cd785f5b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:47.526919 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c8421ba-057e-4edd-8da5-4fa0cd785f5b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:47.526919 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c8421ba-057e-4edd-8da5-4fa0cd785f5b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:47.527239 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c8421ba-057e-4edd-8da5-4fa0cd785f5b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:47.527239 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6c8421ba-057e-4edd-8da5-4fa0cd785f5b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:47.531552 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d28e565e-f217-4c9c-9809-21ecb4162538 req-ab399315-a10a-449a-bee4-4ef3dbe599a4 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:47.532032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d28e565e-f217-4c9c-9809-21ecb4162538 req-ab399315-a10a-449a-bee4-4ef3dbe599a4 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:47.532861 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d28e565e-f217-4c9c-9809-21ecb4162538 req-ab399315-a10a-449a-bee4-4ef3dbe599a4 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:47.544936 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-d28e565e-f217-4c9c-9809-21ecb4162538 req-ab399315-a10a-449a-bee4-4ef3dbe599a4 service nova] Creating event network-changed:fb9f85b8-7682-4117-938b-7225f55cd3b2 for instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 on hv-cinder-81571 Aug 30 01:17:47.553131 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-d28e565e-f217-4c9c-9809-21ecb4162538 req-ab399315-a10a-449a-bee4-4ef3dbe599a4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039634 Aug 30 01:17:47.559991 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 458/960] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:47.639276 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-6c8421ba-057e-4edd-8da5-4fa0cd785f5b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lazy-loading 'services' on Instance uuid cfb98683-87f8-47ff-89d6-4d74e9f961d1 {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:17:47.933138 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6c8421ba-057e-4edd-8da5-4fa0cd785f5b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/os-volume_attachments/dbaa4795-359a-4a5f-97d8-79d406510720" status: 202 len: 0 microversion: 2.1 time: 0.422048 Aug 30 01:17:47.936976 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 503/961] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 30 01:17:47 2022] DELETE /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/os-volume_attachments/dbaa4795-359a-4a5f-97d8-79d406510720 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:17:47.943757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-96f05ceb-8ed5-4ddc-8ac8-b85027370be8 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:47.946319 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-96f05ceb-8ed5-4ddc-8ac8-b85027370be8 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:47.955008 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96f05ceb-8ed5-4ddc-8ac8-b85027370be8 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:47.955782 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96f05ceb-8ed5-4ddc-8ac8-b85027370be8 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:47.956158 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96f05ceb-8ed5-4ddc-8ac8-b85027370be8 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:47.956951 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96f05ceb-8ed5-4ddc-8ac8-b85027370be8 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:47.958139 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96f05ceb-8ed5-4ddc-8ac8-b85027370be8 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:47.958610 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-96f05ceb-8ed5-4ddc-8ac8-b85027370be8 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:47.994683 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-96f05ceb-8ed5-4ddc-8ac8-b85027370be8 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055864 Aug 30 01:17:48.001486 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 459/962] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:17:47 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:48.250155 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-91c0fcc9-3014-47f1-91bb-8191a70eae70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:48.250925 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-91c0fcc9-3014-47f1-91bb-8191a70eae70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:48.258322 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:48.260821 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91c0fcc9-3014-47f1-91bb-8191a70eae70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:48.261510 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91c0fcc9-3014-47f1-91bb-8191a70eae70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:48.262290 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91c0fcc9-3014-47f1-91bb-8191a70eae70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:48.263366 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91c0fcc9-3014-47f1-91bb-8191a70eae70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:48.264116 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91c0fcc9-3014-47f1-91bb-8191a70eae70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:48.265251 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91c0fcc9-3014-47f1-91bb-8191a70eae70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:48.443681 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-91c0fcc9-3014-47f1-91bb-8191a70eae70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:48.453383 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-91c0fcc9-3014-47f1-91bb-8191a70eae70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:48.455082 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-91c0fcc9-3014-47f1-91bb-8191a70eae70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:48.456276 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-91c0fcc9-3014-47f1-91bb-8191a70eae70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.210841 Aug 30 01:17:48.456842 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 504/963] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:48 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:49.007183 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-976ade80-87b4-4e70-b6fe-6250d3ff634b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:49.009341 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-976ade80-87b4-4e70-b6fe-6250d3ff634b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:49.011867 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:49.017265 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-976ade80-87b4-4e70-b6fe-6250d3ff634b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:49.017768 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-976ade80-87b4-4e70-b6fe-6250d3ff634b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:49.018208 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-976ade80-87b4-4e70-b6fe-6250d3ff634b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:49.018906 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-976ade80-87b4-4e70-b6fe-6250d3ff634b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:49.019731 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-976ade80-87b4-4e70-b6fe-6250d3ff634b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:49.020268 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-976ade80-87b4-4e70-b6fe-6250d3ff634b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:49.051657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-976ade80-87b4-4e70-b6fe-6250d3ff634b tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048300 Aug 30 01:17:49.052169 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 460/964] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:17:49 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:49.494464 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5c2cda0a-9f5b-4318-8607-81802650c31e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:49.495737 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5c2cda0a-9f5b-4318-8607-81802650c31e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:49.504409 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c2cda0a-9f5b-4318-8607-81802650c31e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:49.504917 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c2cda0a-9f5b-4318-8607-81802650c31e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:49.505359 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c2cda0a-9f5b-4318-8607-81802650c31e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:49.506101 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c2cda0a-9f5b-4318-8607-81802650c31e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:49.506557 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c2cda0a-9f5b-4318-8607-81802650c31e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:49.507131 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c2cda0a-9f5b-4318-8607-81802650c31e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:49.716388 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5c2cda0a-9f5b-4318-8607-81802650c31e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:49.726195 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5c2cda0a-9f5b-4318-8607-81802650c31e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:49.727767 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5c2cda0a-9f5b-4318-8607-81802650c31e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:49.728981 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5c2cda0a-9f5b-4318-8607-81802650c31e tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.241705 Aug 30 01:17:49.730400 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 505/965] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:49 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:50.064271 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-20623acf-a46e-498b-9afd-c33a71a2a202 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:50.066505 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-20623acf-a46e-498b-9afd-c33a71a2a202 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:50.073360 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20623acf-a46e-498b-9afd-c33a71a2a202 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:50.074086 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20623acf-a46e-498b-9afd-c33a71a2a202 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:50.074319 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20623acf-a46e-498b-9afd-c33a71a2a202 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:50.075029 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20623acf-a46e-498b-9afd-c33a71a2a202 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:50.075488 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20623acf-a46e-498b-9afd-c33a71a2a202 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:50.075919 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-20623acf-a46e-498b-9afd-c33a71a2a202 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:50.107542 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-20623acf-a46e-498b-9afd-c33a71a2a202 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047916 Aug 30 01:17:50.108859 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 461/966] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:17:50 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:17:50.128137 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c0d0317a-c197-4194-b245-1e407c950c0c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:50.129110 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c0d0317a-c197-4194-b245-1e407c950c0c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:50.137868 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c0d0317a-c197-4194-b245-1e407c950c0c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:50.138356 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c0d0317a-c197-4194-b245-1e407c950c0c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:50.138908 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c0d0317a-c197-4194-b245-1e407c950c0c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:50.139835 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c0d0317a-c197-4194-b245-1e407c950c0c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:50.140304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c0d0317a-c197-4194-b245-1e407c950c0c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:50.140730 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c0d0317a-c197-4194-b245-1e407c950c0c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:50.239496 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-c0d0317a-c197-4194-b245-1e407c950c0c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] HTTP exception thrown: Instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 is not attached to volume dbaa4795-359a-4a5f-97d8-79d406510720 Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c0d0317a-c197-4194-b245-1e407c950c0c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Request method failure captured: Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: DELETE /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/os-volume_attachments/dbaa4795-359a-4a5f-97d8-79d406510720 HTTP/1.1 Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWSdnh2jSKDmyAG7ZOJ-gi7H3axMf5vDN7rY284j-ODzzGoYORvEy2Ydu4psWTq396sSfx60BYc9wuKxkgNS0ld3E_Xt4sajNPtoMpoVK6-KI_s75q6FBTJbRJKsxFYzPnSq3Ks66E3wsYC3n3yjnTTNuuGjwlDscLe6LqWM45nN1O0 Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: c6f3997439524d4583ece79273a55da4 Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-TestMinimumBasicScenario-1242635238 Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:17:50.241983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:17:50.243713 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c6f3997439524d4583ece79273a55da4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c6f3997439524d4583ece79273a55da4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6f3997439524d4583ece79273a55da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6f3997439524d4583ece79273a55da4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:17:50.243713 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-TestMinimumBasicScenario-1242635238 Aug 30 01:17:50.243713 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: c6f3997439524d4583ece79273a55da4 Aug 30 01:17:50.243713 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1242635238 Aug 30 01:17:50.243713 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-TestMinimumBasicScenario-1242635238-project Aug 30 01:17:50.243713 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:17:50.243713 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:17:50.243713 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: fdf94212f7654ff396be6dc2c2ca4874 Aug 30 01:17:50.243713 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-TestMinimumBasicScenario-1242635238-project Aug 30 01:17:50.243713 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:17:50.243713 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 is not attached to volume dbaa4795-359a-4a5f-97d8-79d406510720 Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'server_id': 'cfb98683-87f8-47ff-89d6-4d74e9f961d1', 'id': 'dbaa4795-359a-4a5f-97d8-79d406510720'} Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id dbaa4795-359a-4a5f-97d8-79d406510720. Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:17:50.245007 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:17:50.246568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:17:50.246568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 01:17:50.246568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 01:17:50.246568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 is not attached to volume dbaa4795-359a-4a5f-97d8-79d406510720 Aug 30 01:17:50.246568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:50.246568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:17:50.246568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:50.246568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:17:50.246568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:17:50.246568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:17:50.246568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:17:50.246568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:17:50.246568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 is not attached to volume dbaa4795-359a-4a5f-97d8-79d406510720 Aug 30 01:17:50.246568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:17:50.246568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c0d0317a-c197-4194-b245-1e407c950c0c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Returning 404 to user: Instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 is not attached to volume dbaa4795-359a-4a5f-97d8-79d406510720 {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:17:50.247839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c0d0317a-c197-4194-b245-1e407c950c0c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/os-volume_attachments/dbaa4795-359a-4a5f-97d8-79d406510720" status: 404 len: 154 microversion: 2.1 time: 0.126127 Aug 30 01:17:50.247839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 506/967] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 30 01:17:50 2022] DELETE /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1/os-volume_attachments/dbaa4795-359a-4a5f-97d8-79d406510720 => generated 154 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:17:50.755938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cba71247-9d42-43e4-b68d-25a5c8c83b17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:50.758050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cba71247-9d42-43e4-b68d-25a5c8c83b17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:50.763223 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cba71247-9d42-43e4-b68d-25a5c8c83b17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:50.766975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cba71247-9d42-43e4-b68d-25a5c8c83b17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:50.766975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cba71247-9d42-43e4-b68d-25a5c8c83b17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:50.766975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cba71247-9d42-43e4-b68d-25a5c8c83b17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:50.766975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cba71247-9d42-43e4-b68d-25a5c8c83b17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:50.767395 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cba71247-9d42-43e4-b68d-25a5c8c83b17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:50.961461 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-9643d268-de35-4320-8d05-0a5dcaab0f58 req-8ed92172-38b5-4a7f-88d0-7cf5cb6431cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b743eb-1b3f-458d-ad48-d60c3934ba0d", "name": "network-vif-plugged", "status": "completed", "tag": "adb8f445-f2e5-41a5-91ba-43406b91be88"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:50.963745 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cba71247-9d42-43e4-b68d-25a5c8c83b17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:50.975394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-9643d268-de35-4320-8d05-0a5dcaab0f58 req-8ed92172-38b5-4a7f-88d0-7cf5cb6431cd service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:50.977212 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-9643d268-de35-4320-8d05-0a5dcaab0f58 req-8ed92172-38b5-4a7f-88d0-7cf5cb6431cd service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:50.977322 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cba71247-9d42-43e4-b68d-25a5c8c83b17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:50.977426 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-9643d268-de35-4320-8d05-0a5dcaab0f58 req-8ed92172-38b5-4a7f-88d0-7cf5cb6431cd service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:50.978876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cba71247-9d42-43e4-b68d-25a5c8c83b17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:50.980563 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cba71247-9d42-43e4-b68d-25a5c8c83b17 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.229475 Aug 30 01:17:50.981606 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 462/968] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:50 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:50.996710 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-9643d268-de35-4320-8d05-0a5dcaab0f58 req-8ed92172-38b5-4a7f-88d0-7cf5cb6431cd service nova] Creating event network-vif-plugged:adb8f445-f2e5-41a5-91ba-43406b91be88 for instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d on hv-cinder-81571 Aug 30 01:17:51.004178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-9643d268-de35-4320-8d05-0a5dcaab0f58 req-8ed92172-38b5-4a7f-88d0-7cf5cb6431cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044081 Aug 30 01:17:51.004178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 507/969] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:17:51.543272 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b5bb5c4f-4a45-4619-8fe6-d3ed8b7cf964 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:51.543821 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b5bb5c4f-4a45-4619-8fe6-d3ed8b7cf964 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:51.550433 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5bb5c4f-4a45-4619-8fe6-d3ed8b7cf964 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:51.550918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5bb5c4f-4a45-4619-8fe6-d3ed8b7cf964 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:51.551356 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5bb5c4f-4a45-4619-8fe6-d3ed8b7cf964 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:51.552051 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5bb5c4f-4a45-4619-8fe6-d3ed8b7cf964 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:51.552504 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5bb5c4f-4a45-4619-8fe6-d3ed8b7cf964 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:51.552932 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5bb5c4f-4a45-4619-8fe6-d3ed8b7cf964 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:51.578747 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b5bb5c4f-4a45-4619-8fe6-d3ed8b7cf964 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:17:51.733464 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:INSERT=2,nova_cell1:SELECT=93 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:51.930457 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b5bb5c4f-4a45-4619-8fe6-d3ed8b7cf964 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 204 len: 0 microversion: 2.1 time: 0.388504 Aug 30 01:17:51.930457 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 463/970] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:17:51 2022] DELETE /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:17:51.938649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-389e6fcb-33bd-4c09-b1a8-ef7fd8f051b3 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:51.939459 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-389e6fcb-33bd-4c09-b1a8-ef7fd8f051b3 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:51.945977 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-389e6fcb-33bd-4c09-b1a8-ef7fd8f051b3 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:51.946544 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-389e6fcb-33bd-4c09-b1a8-ef7fd8f051b3 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:51.947087 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-389e6fcb-33bd-4c09-b1a8-ef7fd8f051b3 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:51.947912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-389e6fcb-33bd-4c09-b1a8-ef7fd8f051b3 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:51.948605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-389e6fcb-33bd-4c09-b1a8-ef7fd8f051b3 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:51.949041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-389e6fcb-33bd-4c09-b1a8-ef7fd8f051b3 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:52.006613 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-63cca8b5-4dde-4056-b6af-7860d78f1250 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:52.007323 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-63cca8b5-4dde-4056-b6af-7860d78f1250 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:52.014008 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63cca8b5-4dde-4056-b6af-7860d78f1250 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:52.016370 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63cca8b5-4dde-4056-b6af-7860d78f1250 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:52.016867 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63cca8b5-4dde-4056-b6af-7860d78f1250 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:52.020087 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63cca8b5-4dde-4056-b6af-7860d78f1250 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:52.020574 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63cca8b5-4dde-4056-b6af-7860d78f1250 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:52.021021 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63cca8b5-4dde-4056-b6af-7860d78f1250 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:52.138811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-389e6fcb-33bd-4c09-b1a8-ef7fd8f051b3 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:52.150033 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-389e6fcb-33bd-4c09-b1a8-ef7fd8f051b3 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1552 microversion: 2.1 time: 0.216192 Aug 30 01:17:52.151258 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 508/971] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:51 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1552 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:52.188026 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-63cca8b5-4dde-4056-b6af-7860d78f1250 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:52.197330 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-63cca8b5-4dde-4056-b6af-7860d78f1250 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:52.198810 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-63cca8b5-4dde-4056-b6af-7860d78f1250 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:52.199964 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-63cca8b5-4dde-4056-b6af-7860d78f1250 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.198418 Aug 30 01:17:52.200520 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 464/972] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:52 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:53.162865 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d1aeed7e-82a5-480b-93fe-5d9f96786636 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:53.163458 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d1aeed7e-82a5-480b-93fe-5d9f96786636 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:53.173140 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6467ccd8-0caa-48ca-85ca-0a33e67e9d8e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:53.173874 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6467ccd8-0caa-48ca-85ca-0a33e67e9d8e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:53.180810 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6467ccd8-0caa-48ca-85ca-0a33e67e9d8e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:53.184191 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d1aeed7e-82a5-480b-93fe-5d9f96786636 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:53.184751 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d1aeed7e-82a5-480b-93fe-5d9f96786636 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:53.185249 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d1aeed7e-82a5-480b-93fe-5d9f96786636 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:53.185771 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6467ccd8-0caa-48ca-85ca-0a33e67e9d8e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:53.186675 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d1aeed7e-82a5-480b-93fe-5d9f96786636 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:53.187288 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6467ccd8-0caa-48ca-85ca-0a33e67e9d8e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:53.187758 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d1aeed7e-82a5-480b-93fe-5d9f96786636 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:53.188509 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6467ccd8-0caa-48ca-85ca-0a33e67e9d8e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:53.189011 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d1aeed7e-82a5-480b-93fe-5d9f96786636 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:53.190226 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6467ccd8-0caa-48ca-85ca-0a33e67e9d8e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:53.190696 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6467ccd8-0caa-48ca-85ca-0a33e67e9d8e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:53.215904 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d1aeed7e-82a5-480b-93fe-5d9f96786636 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290/ips" status: 200 len: 151 microversion: 2.1 time: 0.057030 Aug 30 01:17:53.216599 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 509/973] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 30 01:17:53 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290/ips => generated 151 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:53.223932 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-542c36a1-a291-42ee-ba6a-fcf60059b1b9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:53.224700 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-542c36a1-a291-42ee-ba6a-fcf60059b1b9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:53.243433 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-542c36a1-a291-42ee-ba6a-fcf60059b1b9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:53.244224 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-542c36a1-a291-42ee-ba6a-fcf60059b1b9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:53.244743 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-542c36a1-a291-42ee-ba6a-fcf60059b1b9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:53.245419 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-542c36a1-a291-42ee-ba6a-fcf60059b1b9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:53.251419 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-542c36a1-a291-42ee-ba6a-fcf60059b1b9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:53.252108 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-542c36a1-a291-42ee-ba6a-fcf60059b1b9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:53.355610 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6467ccd8-0caa-48ca-85ca-0a33e67e9d8e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:53.364680 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6467ccd8-0caa-48ca-85ca-0a33e67e9d8e tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1552 microversion: 2.1 time: 0.195943 Aug 30 01:17:53.365305 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 465/974] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:53 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1552 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:17:53.411000 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-542c36a1-a291-42ee-ba6a-fcf60059b1b9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:53.422266 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-542c36a1-a291-42ee-ba6a-fcf60059b1b9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:53.424486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-542c36a1-a291-42ee-ba6a-fcf60059b1b9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:53.426076 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-542c36a1-a291-42ee-ba6a-fcf60059b1b9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.206144 Aug 30 01:17:53.426844 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 510/975] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:53 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:17:54.391761 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-112a5edf-6d4c-49fa-a07a-4b0a17e388b5 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:54.391761 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-112a5edf-6d4c-49fa-a07a-4b0a17e388b5 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:54.420692 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-112a5edf-6d4c-49fa-a07a-4b0a17e388b5 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:54.421362 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-112a5edf-6d4c-49fa-a07a-4b0a17e388b5 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:54.422353 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-112a5edf-6d4c-49fa-a07a-4b0a17e388b5 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:54.423140 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-112a5edf-6d4c-49fa-a07a-4b0a17e388b5 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:54.424438 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-112a5edf-6d4c-49fa-a07a-4b0a17e388b5 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:54.424975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-112a5edf-6d4c-49fa-a07a-4b0a17e388b5 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:54.451543 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5d5ee3cf-33af-4e4d-b96c-aa57c73a930b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:54.455472 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5d5ee3cf-33af-4e4d-b96c-aa57c73a930b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:54.467331 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5d5ee3cf-33af-4e4d-b96c-aa57c73a930b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:54.469944 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5d5ee3cf-33af-4e4d-b96c-aa57c73a930b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:54.471935 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5d5ee3cf-33af-4e4d-b96c-aa57c73a930b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:54.473881 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5d5ee3cf-33af-4e4d-b96c-aa57c73a930b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:54.474499 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5d5ee3cf-33af-4e4d-b96c-aa57c73a930b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:54.475047 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5d5ee3cf-33af-4e4d-b96c-aa57c73a930b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:54.645607 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5d5ee3cf-33af-4e4d-b96c-aa57c73a930b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:54.662890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5d5ee3cf-33af-4e4d-b96c-aa57c73a930b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:54.664917 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5d5ee3cf-33af-4e4d-b96c-aa57c73a930b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:54.667247 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5d5ee3cf-33af-4e4d-b96c-aa57c73a930b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.219929 Aug 30 01:17:54.668276 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 511/976] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:54 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:17:54.737996 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-112a5edf-6d4c-49fa-a07a-4b0a17e388b5 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:54.751391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-112a5edf-6d4c-49fa-a07a-4b0a17e388b5 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1552 microversion: 2.1 time: 0.368197 Aug 30 01:17:54.756776 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 466/977] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:54 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1552 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:55.090732 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-da316a15-cd4a-4793-8716-dfdb5487536a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8506731b-734a-4a57-8b4f-d8ab4c9d65d7"}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:55.094120 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-da316a15-cd4a-4793-8716-dfdb5487536a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:55.100373 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da316a15-cd4a-4793-8716-dfdb5487536a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:55.100867 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da316a15-cd4a-4793-8716-dfdb5487536a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:55.101347 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da316a15-cd4a-4793-8716-dfdb5487536a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:55.102173 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da316a15-cd4a-4793-8716-dfdb5487536a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:55.102890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da316a15-cd4a-4793-8716-dfdb5487536a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:55.103477 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da316a15-cd4a-4793-8716-dfdb5487536a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:55.693324 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dcb9a1e8-162f-4f6a-b124-2cbec81e8630 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:55.694046 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dcb9a1e8-162f-4f6a-b124-2cbec81e8630 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:55.701401 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dcb9a1e8-162f-4f6a-b124-2cbec81e8630 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:55.702633 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dcb9a1e8-162f-4f6a-b124-2cbec81e8630 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:55.703529 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dcb9a1e8-162f-4f6a-b124-2cbec81e8630 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:55.704517 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dcb9a1e8-162f-4f6a-b124-2cbec81e8630 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:55.705177 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dcb9a1e8-162f-4f6a-b124-2cbec81e8630 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:55.705611 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dcb9a1e8-162f-4f6a-b124-2cbec81e8630 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:56.023657 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-da316a15-cd4a-4793-8716-dfdb5487536a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "POST /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.936885 Aug 30 01:17:56.024447 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 512/978] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 30 01:17:55 2022] POST /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290/os-volume_attachments => generated 194 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:56.047214 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-9d1de9f8-24de-4080-9370-cf930f5684da tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:56.048662 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-9d1de9f8-24de-4080-9370-cf930f5684da tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:56.057032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d1de9f8-24de-4080-9370-cf930f5684da tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:56.060308 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d1de9f8-24de-4080-9370-cf930f5684da tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:56.061657 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d1de9f8-24de-4080-9370-cf930f5684da tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:56.064055 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d1de9f8-24de-4080-9370-cf930f5684da tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:56.064619 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d1de9f8-24de-4080-9370-cf930f5684da tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:56.065231 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-9d1de9f8-24de-4080-9370-cf930f5684da tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:56.235417 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dcb9a1e8-162f-4f6a-b124-2cbec81e8630 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:56.255317 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dcb9a1e8-162f-4f6a-b124-2cbec81e8630 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:56.261810 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dcb9a1e8-162f-4f6a-b124-2cbec81e8630 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:56.263088 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dcb9a1e8-162f-4f6a-b124-2cbec81e8630 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.573873 Aug 30 01:17:56.263684 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 467/979] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:55 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:56.287873 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-9d1de9f8-24de-4080-9370-cf930f5684da tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:56.303200 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-9d1de9f8-24de-4080-9370-cf930f5684da tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1552 microversion: 2.1 time: 0.277204 Aug 30 01:17:56.303732 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 513/980] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:56 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1552 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:56.532166 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-3aa04c41-1ecc-4fc2-a1c8-57092d520042 req-12b82274-fce4-4452-9154-c32e733b8ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb98683-87f8-47ff-89d6-4d74e9f961d1", "name": "network-vif-deleted", "tag": "fb9f85b8-7682-4117-938b-7225f55cd3b2"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:17:56.543648 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3aa04c41-1ecc-4fc2-a1c8-57092d520042 req-12b82274-fce4-4452-9154-c32e733b8ddb service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:56.544121 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3aa04c41-1ecc-4fc2-a1c8-57092d520042 req-12b82274-fce4-4452-9154-c32e733b8ddb service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:56.544544 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3aa04c41-1ecc-4fc2-a1c8-57092d520042 req-12b82274-fce4-4452-9154-c32e733b8ddb service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:56.559462 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-3aa04c41-1ecc-4fc2-a1c8-57092d520042 req-12b82274-fce4-4452-9154-c32e733b8ddb service nova] Creating event network-vif-deleted:fb9f85b8-7682-4117-938b-7225f55cd3b2 for instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 on hv-cinder-81571 Aug 30 01:17:56.564695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-3aa04c41-1ecc-4fc2-a1c8-57092d520042 req-12b82274-fce4-4452-9154-c32e733b8ddb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036885 Aug 30 01:17:56.565307 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 468/981] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:17:57.289884 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-7665ecb8-b4ae-4c9f-86d3-0885f5340916 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:57.290508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-7665ecb8-b4ae-4c9f-86d3-0885f5340916 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:57.300954 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7665ecb8-b4ae-4c9f-86d3-0885f5340916 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:57.301787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7665ecb8-b4ae-4c9f-86d3-0885f5340916 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:57.302430 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7665ecb8-b4ae-4c9f-86d3-0885f5340916 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:57.303225 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7665ecb8-b4ae-4c9f-86d3-0885f5340916 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:57.303838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7665ecb8-b4ae-4c9f-86d3-0885f5340916 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:57.304431 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7665ecb8-b4ae-4c9f-86d3-0885f5340916 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:57.307627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:17:57.325609 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-504bfd6e-e080-41f7-8a09-fa17206ea859 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:57.327198 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-504bfd6e-e080-41f7-8a09-fa17206ea859 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:57.333980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-504bfd6e-e080-41f7-8a09-fa17206ea859 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:57.334809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-504bfd6e-e080-41f7-8a09-fa17206ea859 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:57.335486 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-504bfd6e-e080-41f7-8a09-fa17206ea859 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:57.336409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-504bfd6e-e080-41f7-8a09-fa17206ea859 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:57.337110 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-504bfd6e-e080-41f7-8a09-fa17206ea859 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:57.337866 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-504bfd6e-e080-41f7-8a09-fa17206ea859 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:57.415883 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-504bfd6e-e080-41f7-8a09-fa17206ea859 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:57.433177 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-504bfd6e-e080-41f7-8a09-fa17206ea859 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1510 microversion: 2.1 time: 0.109535 Aug 30 01:17:57.446869 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 469/982] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:57 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1510 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:57.473151 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7665ecb8-b4ae-4c9f-86d3-0885f5340916 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:57.490246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7665ecb8-b4ae-4c9f-86d3-0885f5340916 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:57.491715 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7665ecb8-b4ae-4c9f-86d3-0885f5340916 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:57.493117 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-7665ecb8-b4ae-4c9f-86d3-0885f5340916 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.207504 Aug 30 01:17:57.493869 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 514/983] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:57 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:58.458050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f8970be2-6ff1-4bf4-a4e8-e583a790c078 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:58.458050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f8970be2-6ff1-4bf4-a4e8-e583a790c078 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:58.468018 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8970be2-6ff1-4bf4-a4e8-e583a790c078 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:58.468929 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8970be2-6ff1-4bf4-a4e8-e583a790c078 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:58.469555 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8970be2-6ff1-4bf4-a4e8-e583a790c078 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:58.470498 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8970be2-6ff1-4bf4-a4e8-e583a790c078 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:58.474182 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8970be2-6ff1-4bf4-a4e8-e583a790c078 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:58.474837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8970be2-6ff1-4bf4-a4e8-e583a790c078 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:58.526337 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-da43d7eb-cff2-4eac-a1ab-7232bda68ba7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:58.527214 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-da43d7eb-cff2-4eac-a1ab-7232bda68ba7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:58.540106 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da43d7eb-cff2-4eac-a1ab-7232bda68ba7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:58.540610 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da43d7eb-cff2-4eac-a1ab-7232bda68ba7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:58.541049 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da43d7eb-cff2-4eac-a1ab-7232bda68ba7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:58.545933 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da43d7eb-cff2-4eac-a1ab-7232bda68ba7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:58.546497 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da43d7eb-cff2-4eac-a1ab-7232bda68ba7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:58.547416 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-da43d7eb-cff2-4eac-a1ab-7232bda68ba7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:58.624698 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f8970be2-6ff1-4bf4-a4e8-e583a790c078 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:58.635482 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f8970be2-6ff1-4bf4-a4e8-e583a790c078 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1510 microversion: 2.1 time: 0.182206 Aug 30 01:17:58.637071 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 470/984] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:58 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:58.799134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-da43d7eb-cff2-4eac-a1ab-7232bda68ba7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:58.819417 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-da43d7eb-cff2-4eac-a1ab-7232bda68ba7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:58.821932 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-da43d7eb-cff2-4eac-a1ab-7232bda68ba7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:58.823362 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-da43d7eb-cff2-4eac-a1ab-7232bda68ba7 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1728 microversion: 2.20 time: 0.303062 Aug 30 01:17:58.824459 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 515/985] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:58 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1728 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:17:59.662607 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e3285411-29ac-4c1a-beff-56c64d86e379 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:59.663211 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e3285411-29ac-4c1a-beff-56c64d86e379 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:59.669950 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3285411-29ac-4c1a-beff-56c64d86e379 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:59.671082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3285411-29ac-4c1a-beff-56c64d86e379 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:59.671525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3285411-29ac-4c1a-beff-56c64d86e379 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:59.672239 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3285411-29ac-4c1a-beff-56c64d86e379 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:59.672689 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3285411-29ac-4c1a-beff-56c64d86e379 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:59.673108 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3285411-29ac-4c1a-beff-56c64d86e379 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:59.706002 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3285411-29ac-4c1a-beff-56c64d86e379 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:59.706475 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3285411-29ac-4c1a-beff-56c64d86e379 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:59.706909 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3285411-29ac-4c1a-beff-56c64d86e379 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:59.707349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-e3285411-29ac-4c1a-beff-56c64d86e379 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lazy-loading 'fault' on Instance uuid cfb98683-87f8-47ff-89d6-4d74e9f961d1 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:17:59.755011 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e3285411-29ac-4c1a-beff-56c64d86e379 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf94212f7654ff396be6dc2c2ca4874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6f3997439524d4583ece79273a55da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:17:59.766216 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e3285411-29ac-4c1a-beff-56c64d86e379 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 200 len: 1347 microversion: 2.1 time: 0.106612 Aug 30 01:17:59.766620 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 471/986] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:17:59 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 1347 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:17:59.847142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a948ce2f-31b1-4bf1-b942-fc177fc4ec5f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:17:59.847796 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a948ce2f-31b1-4bf1-b942-fc177fc4ec5f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:17:59.854912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a948ce2f-31b1-4bf1-b942-fc177fc4ec5f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:59.855738 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a948ce2f-31b1-4bf1-b942-fc177fc4ec5f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:59.856351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a948ce2f-31b1-4bf1-b942-fc177fc4ec5f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:17:59.857414 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a948ce2f-31b1-4bf1-b942-fc177fc4ec5f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:17:59.858904 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a948ce2f-31b1-4bf1-b942-fc177fc4ec5f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:17:59.859671 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a948ce2f-31b1-4bf1-b942-fc177fc4ec5f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:00.001391 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a948ce2f-31b1-4bf1-b942-fc177fc4ec5f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:00.012407 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a948ce2f-31b1-4bf1-b942-fc177fc4ec5f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:00.014025 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a948ce2f-31b1-4bf1-b942-fc177fc4ec5f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:00.015325 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a948ce2f-31b1-4bf1-b942-fc177fc4ec5f tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1715 microversion: 2.20 time: 0.173322 Aug 30 01:18:00.015890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 516/987] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:17:59 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1715 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:18:00.789234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-45ba68b1-710e-4b5f-8b77-43526e0085c7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:00.789885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-45ba68b1-710e-4b5f-8b77-43526e0085c7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] [instance: cfb98683-87f8-47ff-89d6-4d74e9f961d1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:00.799100 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45ba68b1-710e-4b5f-8b77-43526e0085c7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:00.799592 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45ba68b1-710e-4b5f-8b77-43526e0085c7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:00.800035 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45ba68b1-710e-4b5f-8b77-43526e0085c7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:00.800739 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45ba68b1-710e-4b5f-8b77-43526e0085c7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:00.801194 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45ba68b1-710e-4b5f-8b77-43526e0085c7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:00.801845 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45ba68b1-710e-4b5f-8b77-43526e0085c7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:00.818450 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-45ba68b1-710e-4b5f-8b77-43526e0085c7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] HTTP exception thrown: Instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 could not be found. Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-45ba68b1-710e-4b5f-8b77-43526e0085c7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Request method failure captured: Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 HTTP/1.1 Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWSdnh2jSKDmyAG7ZOJ-gi7H3axMf5vDN7rY284j-ODzzGoYORvEy2Ydu4psWTq396sSfx60BYc9wuKxkgNS0ld3E_Xt4sajNPtoMpoVK6-KI_s75q6FBTJbRJKsxFYzPnSq3Ks66E3wsYC3n3yjnTTNuuGjwlDscLe6LqWM45nN1O0 Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: c6f3997439524d4583ece79273a55da4 Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-TestMinimumBasicScenario-1242635238 Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:18:00.820266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:18:00.821885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c6f3997439524d4583ece79273a55da4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c6f3997439524d4583ece79273a55da4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6f3997439524d4583ece79273a55da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c6f3997439524d4583ece79273a55da4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:00.821885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-TestMinimumBasicScenario-1242635238 Aug 30 01:18:00.821885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: c6f3997439524d4583ece79273a55da4 Aug 30 01:18:00.821885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1242635238 Aug 30 01:18:00.821885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-TestMinimumBasicScenario-1242635238-project Aug 30 01:18:00.821885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:18:00.821885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:18:00.821885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: fdf94212f7654ff396be6dc2c2ca4874 Aug 30 01:18:00.821885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-TestMinimumBasicScenario-1242635238-project Aug 30 01:18:00.821885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:18:00.821885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 could not be found. Aug 30 01:18:00.821885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': 'cfb98683-87f8-47ff-89d6-4d74e9f961d1'} Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 could not be found. Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:00.822831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 could not be found. Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 could not be found. Aug 30 01:18:00.825901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:00.828975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-45ba68b1-710e-4b5f-8b77-43526e0085c7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Returning 404 to user: Instance cfb98683-87f8-47ff-89d6-4d74e9f961d1 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:00.828975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-45ba68b1-710e-4b5f-8b77-43526e0085c7 tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1" status: 404 len: 111 microversion: 2.1 time: 0.038172 Aug 30 01:18:00.828975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 472/988] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:00 2022] GET /compute/v2.1/servers/cfb98683-87f8-47ff-89d6-4d74e9f961d1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:00.832897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-caace576-b8c0-4e17-9a95-d1ba2f0e662c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] Calling method '.version_select at 0x7fd71d0563a0>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:00.987048 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-caace576-b8c0-4e17-9a95-d1ba2f0e662c tempest-TestMinimumBasicScenario-1242635238 tempest-TestMinimumBasicScenario-1242635238-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-298168218" status: 202 len: 0 microversion: 2.1 time: 0.158571 Aug 30 01:18:00.988465 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 517/989] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Aug 30 01:18:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-298168218 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:18:07.267753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8e59dd4f-68c9-4418-8b3e-d510e996c711 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:07.268837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8e59dd4f-68c9-4418-8b3e-d510e996c711 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:07.275962 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e59dd4f-68c9-4418-8b3e-d510e996c711 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:07.276824 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e59dd4f-68c9-4418-8b3e-d510e996c711 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:07.277361 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e59dd4f-68c9-4418-8b3e-d510e996c711 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:07.278206 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e59dd4f-68c9-4418-8b3e-d510e996c711 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:07.279040 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e59dd4f-68c9-4418-8b3e-d510e996c711 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:07.280141 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e59dd4f-68c9-4418-8b3e-d510e996c711 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:07.416158 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-8e59dd4f-68c9-4418-8b3e-d510e996c711 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lazy-loading 'services' on Instance uuid 435521f1-f793-4834-9915-bb47962b6290 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:18:07.772352 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8e59dd4f-68c9-4418-8b3e-d510e996c711 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290/os-volume_attachments/8506731b-734a-4a57-8b4f-d8ab4c9d65d7" status: 202 len: 0 microversion: 2.1 time: 0.509232 Aug 30 01:18:07.772955 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 473/990] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 30 01:18:07 2022] DELETE /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290/os-volume_attachments/8506731b-734a-4a57-8b4f-d8ab4c9d65d7 => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:18:07.781824 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4352204a-683b-41da-9e39-e3f7799207c7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:07.785147 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4352204a-683b-41da-9e39-e3f7799207c7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:07.794710 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4352204a-683b-41da-9e39-e3f7799207c7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:07.795887 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4352204a-683b-41da-9e39-e3f7799207c7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:07.796385 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4352204a-683b-41da-9e39-e3f7799207c7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:07.797147 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4352204a-683b-41da-9e39-e3f7799207c7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:07.797665 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4352204a-683b-41da-9e39-e3f7799207c7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:07.798234 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4352204a-683b-41da-9e39-e3f7799207c7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:07.835206 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4352204a-683b-41da-9e39-e3f7799207c7 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057680 Aug 30 01:18:07.836020 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 518/991] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:18:07 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:08.324717 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-225a5fb2-e3f3-4c7a-9ee3-2b830897588e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Action: 'create', calling method: .version_select at 0x7fd71d27e430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1963560351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnSWx98FXb8VzDOnIEh/NjKNouUuSqWPrvmlk9KTdJZ0fKl7Jg4+FTOxZCi3P5gb2nI3uFsiKGn2pYJw/tEcAruNqqMgchxFfzo97P5Gp2hkl+ybaoN5oqFc15jJkHljw=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:08.352698 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-225a5fb2-e3f3-4c7a-9ee3-2b830897588e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Getting quotas for project ba3bd03ea50c4553b9b98b61a4d835dd. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:18:08.371304 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-225a5fb2-e3f3-4c7a-9ee3-2b830897588e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Getting quotas for user 9352fbf7d98b40d7954ce1ff3d968761 and project ba3bd03ea50c4553b9b98b61a4d835dd. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:18:08.497969 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-225a5fb2-e3f3-4c7a-9ee3-2b830897588e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.392347 Aug 30 01:18:08.499235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 474/992] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 30 01:18:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:08.849349 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-3a944645-1549-46ba-94d0-88f89757f2a0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:08.855037 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-3a944645-1549-46ba-94d0-88f89757f2a0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:08.869205 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a944645-1549-46ba-94d0-88f89757f2a0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:08.870266 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a944645-1549-46ba-94d0-88f89757f2a0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:08.870979 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a944645-1549-46ba-94d0-88f89757f2a0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:08.871858 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a944645-1549-46ba-94d0-88f89757f2a0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:08.872458 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a944645-1549-46ba-94d0-88f89757f2a0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:08.873671 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a944645-1549-46ba-94d0-88f89757f2a0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:08.927794 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-3a944645-1549-46ba-94d0-88f89757f2a0 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078650 Aug 30 01:18:08.934378 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 519/993] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:18:08 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:09.942018 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b6ba0c85-7a36-4807-bdb8-763203e2424f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:09.944761 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b6ba0c85-7a36-4807-bdb8-763203e2424f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:09.953662 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6ba0c85-7a36-4807-bdb8-763203e2424f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:09.954566 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6ba0c85-7a36-4807-bdb8-763203e2424f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:09.955180 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6ba0c85-7a36-4807-bdb8-763203e2424f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:09.955964 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6ba0c85-7a36-4807-bdb8-763203e2424f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:09.956483 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6ba0c85-7a36-4807-bdb8-763203e2424f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:09.956980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6ba0c85-7a36-4807-bdb8-763203e2424f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:09.992647 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b6ba0c85-7a36-4807-bdb8-763203e2424f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055113 Aug 30 01:18:09.993494 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 475/994] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 30 01:18:09 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:18:10.060331 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-168030f2-b0f0-4f1b-a68c-a4c1b3dbdd91 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:10.061506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-168030f2-b0f0-4f1b-a68c-a4c1b3dbdd91 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:10.068276 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-168030f2-b0f0-4f1b-a68c-a4c1b3dbdd91 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:10.069003 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-168030f2-b0f0-4f1b-a68c-a4c1b3dbdd91 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:10.069446 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-168030f2-b0f0-4f1b-a68c-a4c1b3dbdd91 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:10.070184 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-168030f2-b0f0-4f1b-a68c-a4c1b3dbdd91 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:10.070642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-168030f2-b0f0-4f1b-a68c-a4c1b3dbdd91 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:10.071067 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-168030f2-b0f0-4f1b-a68c-a4c1b3dbdd91 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:10.100219 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-168030f2-b0f0-4f1b-a68c-a4c1b3dbdd91 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Going to try to terminate instance {{(pid=121233) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:18:10.426859 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-168030f2-b0f0-4f1b-a68c-a4c1b3dbdd91 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 204 len: 0 microversion: 2.1 time: 0.369895 Aug 30 01:18:10.427518 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 520/995] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:18:10 2022] DELETE /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:18:10.436302 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cc0597c1-2d70-468d-8cc4-57bfd9639792 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:10.436935 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cc0597c1-2d70-468d-8cc4-57bfd9639792 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:10.444868 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc0597c1-2d70-468d-8cc4-57bfd9639792 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:10.448634 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc0597c1-2d70-468d-8cc4-57bfd9639792 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:10.450721 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc0597c1-2d70-468d-8cc4-57bfd9639792 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:10.452205 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc0597c1-2d70-468d-8cc4-57bfd9639792 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:10.454405 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc0597c1-2d70-468d-8cc4-57bfd9639792 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:10.457356 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc0597c1-2d70-468d-8cc4-57bfd9639792 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:10.737961 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cc0597c1-2d70-468d-8cc4-57bfd9639792 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:10.752577 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cc0597c1-2d70-468d-8cc4-57bfd9639792 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1681 microversion: 2.1 time: 0.320563 Aug 30 01:18:10.753205 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 476/996] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:10 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1681 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:11.775866 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-948b014d-1839-42cb-857f-94a3b87c861f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:11.777170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-948b014d-1839-42cb-857f-94a3b87c861f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:11.788119 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-948b014d-1839-42cb-857f-94a3b87c861f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:11.788887 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-948b014d-1839-42cb-857f-94a3b87c861f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:11.789334 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-948b014d-1839-42cb-857f-94a3b87c861f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:11.790150 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-948b014d-1839-42cb-857f-94a3b87c861f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:11.790617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-948b014d-1839-42cb-857f-94a3b87c861f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:11.791051 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-948b014d-1839-42cb-857f-94a3b87c861f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:11.984690 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-948b014d-1839-42cb-857f-94a3b87c861f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:11.994598 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-948b014d-1839-42cb-857f-94a3b87c861f tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1681 microversion: 2.1 time: 0.223495 Aug 30 01:18:11.995320 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 521/997] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:11 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1681 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:13.017368 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d8402e19-90a6-4c39-aebf-0526f5f674ac tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:13.018120 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d8402e19-90a6-4c39-aebf-0526f5f674ac tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:13.026961 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8402e19-90a6-4c39-aebf-0526f5f674ac tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:13.027523 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8402e19-90a6-4c39-aebf-0526f5f674ac tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:13.027954 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8402e19-90a6-4c39-aebf-0526f5f674ac tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:13.028669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8402e19-90a6-4c39-aebf-0526f5f674ac tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:13.029128 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8402e19-90a6-4c39-aebf-0526f5f674ac tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:13.029557 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8402e19-90a6-4c39-aebf-0526f5f674ac tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:13.396259 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d8402e19-90a6-4c39-aebf-0526f5f674ac tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:13.417069 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d8402e19-90a6-4c39-aebf-0526f5f674ac tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1681 microversion: 2.1 time: 0.395942 Aug 30 01:18:13.417069 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 477/998] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:13 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1681 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:14.142729 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-e5363252-8050-4fbb-88a5-411b7bcf75c7 req-a3439c6f-4245-46dd-bf75-c16cb8aeed99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435521f1-f793-4834-9915-bb47962b6290", "name": "network-vif-deleted", "tag": "5c856550-f785-48e4-8e57-b2cf53c786c7"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:14.196742 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-e5363252-8050-4fbb-88a5-411b7bcf75c7 req-a3439c6f-4245-46dd-bf75-c16cb8aeed99 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:14.198415 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-e5363252-8050-4fbb-88a5-411b7bcf75c7 req-a3439c6f-4245-46dd-bf75-c16cb8aeed99 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:14.198963 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-e5363252-8050-4fbb-88a5-411b7bcf75c7 req-a3439c6f-4245-46dd-bf75-c16cb8aeed99 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:14.236412 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-e5363252-8050-4fbb-88a5-411b7bcf75c7 req-a3439c6f-4245-46dd-bf75-c16cb8aeed99 service nova] Creating event network-vif-deleted:5c856550-f785-48e4-8e57-b2cf53c786c7 for instance 435521f1-f793-4834-9915-bb47962b6290 on hv-cinder-81571 Aug 30 01:18:14.251062 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-e5363252-8050-4fbb-88a5-411b7bcf75c7 req-a3439c6f-4245-46dd-bf75-c16cb8aeed99 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110018 Aug 30 01:18:14.256010 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 522/999] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:14.433982 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fb66620d-b1ab-4433-acf6-60f6a5df4bba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:14.437983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fb66620d-b1ab-4433-acf6-60f6a5df4bba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:14.484298 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb66620d-b1ab-4433-acf6-60f6a5df4bba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:14.490274 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb66620d-b1ab-4433-acf6-60f6a5df4bba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:14.490918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb66620d-b1ab-4433-acf6-60f6a5df4bba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:14.492585 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb66620d-b1ab-4433-acf6-60f6a5df4bba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:14.496016 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb66620d-b1ab-4433-acf6-60f6a5df4bba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:14.496501 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fb66620d-b1ab-4433-acf6-60f6a5df4bba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:14.685300 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fb66620d-b1ab-4433-acf6-60f6a5df4bba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:14.696231 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fb66620d-b1ab-4433-acf6-60f6a5df4bba tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1324 microversion: 2.1 time: 0.267856 Aug 30 01:18:14.696824 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 478/1000] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:14 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1324 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:15.728127 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4d585fc1-dd31-4a20-a577-cd3654439a36 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:15.729621 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4d585fc1-dd31-4a20-a577-cd3654439a36 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:15.738467 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4d585fc1-dd31-4a20-a577-cd3654439a36 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:15.738961 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4d585fc1-dd31-4a20-a577-cd3654439a36 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:15.739399 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4d585fc1-dd31-4a20-a577-cd3654439a36 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:15.740308 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4d585fc1-dd31-4a20-a577-cd3654439a36 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:15.740928 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4d585fc1-dd31-4a20-a577-cd3654439a36 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:15.741517 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4d585fc1-dd31-4a20-a577-cd3654439a36 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:15.799124 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4d585fc1-dd31-4a20-a577-cd3654439a36 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:15.799667 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4d585fc1-dd31-4a20-a577-cd3654439a36 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:15.800555 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4d585fc1-dd31-4a20-a577-cd3654439a36 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:15.801011 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-4d585fc1-dd31-4a20-a577-cd3654439a36 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lazy-loading 'fault' on Instance uuid 435521f1-f793-4834-9915-bb47962b6290 {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:18:15.856787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4d585fc1-dd31-4a20-a577-cd3654439a36 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '942d175e7e2742728e66fea84c851038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c8f48af7394a75ab6013ca066751a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:15.872479 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4d585fc1-dd31-4a20-a577-cd3654439a36 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 200 len: 1329 microversion: 2.1 time: 0.151260 Aug 30 01:18:15.873295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 523/1001] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:15 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 1329 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:16.902524 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-894a4f6e-b863-48ad-893b-9c30a1d163e4 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:16.903820 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-894a4f6e-b863-48ad-893b-9c30a1d163e4 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:16.910707 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-894a4f6e-b863-48ad-893b-9c30a1d163e4 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:16.911344 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-894a4f6e-b863-48ad-893b-9c30a1d163e4 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:16.911929 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-894a4f6e-b863-48ad-893b-9c30a1d163e4 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:16.913421 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-894a4f6e-b863-48ad-893b-9c30a1d163e4 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:16.914355 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-894a4f6e-b863-48ad-893b-9c30a1d163e4 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:16.915133 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-894a4f6e-b863-48ad-893b-9c30a1d163e4 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:16.933450 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-894a4f6e-b863-48ad-893b-9c30a1d163e4 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] HTTP exception thrown: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-894a4f6e-b863-48ad-893b-9c30a1d163e4 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Request method failure captured: Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 HTTP/1.1 Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWOflXbDFJWgbl1TJC3Oy148qXhrnxQzWwozAEpLPUvBjkIue1CYn_oh9imGJ1y-bHs91DQfacqzNdoPNGJGBFUNkjPdHbXnb83IH3jbui9qUN0KpZ__R_CPwPnS8jDFUUiZ7g8Gk1RFVQFkhvoh-4PF9zh2BgfTwME3tmMd22zrKs0 Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:18:16.935551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:18:16.937980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:16.937980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:16.937980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:16.937980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:16.937980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:16.937980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:18:16.937980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:18:16.937980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 942d175e7e2742728e66fea84c851038 Aug 30 01:18:16.937980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:16.937980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:18:16.937980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. Aug 30 01:18:16.937980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': '435521f1-f793-4834-9915-bb47962b6290'} Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:16.939091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. Aug 30 01:18:16.940373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:16.941557 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-894a4f6e-b863-48ad-893b-9c30a1d163e4 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Returning 404 to user: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:16.941557 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-894a4f6e-b863-48ad-893b-9c30a1d163e4 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 404 len: 111 microversion: 2.1 time: 0.039745 Aug 30 01:18:16.941557 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 479/1002] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:16 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:16.948400 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-972213cc-0cd2-4847-b7b3-a641c834349a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '.version_select at 0x7fd71cfc39d0>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:17.082031 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-972213cc-0cd2-4847-b7b3-a641c834349a tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2126149" status: 202 len: 0 microversion: 2.1 time: 0.138020 Aug 30 01:18:17.082623 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 524/1003] 10.222.0.52 () {58 vars in 1212 bytes} [Tue Aug 30 01:18:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2126149 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:18:19.364480 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-062dff90-ec71-440e-8901-e98bb715dbd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:19.365190 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-062dff90-ec71-440e-8901-e98bb715dbd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:19.367561 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=4 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:19.375812 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-062dff90-ec71-440e-8901-e98bb715dbd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:19.375812 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-062dff90-ec71-440e-8901-e98bb715dbd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:19.375812 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-062dff90-ec71-440e-8901-e98bb715dbd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:19.375812 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-062dff90-ec71-440e-8901-e98bb715dbd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:19.376221 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-062dff90-ec71-440e-8901-e98bb715dbd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:19.376221 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-062dff90-ec71-440e-8901-e98bb715dbd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:19.389007 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-062dff90-ec71-440e-8901-e98bb715dbd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] HTTP exception thrown: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-062dff90-ec71-440e-8901-e98bb715dbd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Request method failure captured: Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 HTTP/1.1 Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWOflXbDFJWgbl1TJC3Oy148qXhrnxQzWwozAEpLPUvBjkIue1CYn_oh9imGJ1y-bHs91DQfacqzNdoPNGJGBFUNkjPdHbXnb83IH3jbui9qUN0KpZ__R_CPwPnS8jDFUUiZ7g8Gk1RFVQFkhvoh-4PF9zh2BgfTwME3tmMd22zrKs0 Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:18:19.390809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:18:19.392225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:19.392225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:19.392225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:19.392225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:19.392225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:19.392225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:18:19.392225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:18:19.392225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 942d175e7e2742728e66fea84c851038 Aug 30 01:18:19.392225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:19.392225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:18:19.392225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. Aug 30 01:18:19.392225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': '435521f1-f793-4834-9915-bb47962b6290'} Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:19.393409 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. Aug 30 01:18:19.394678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:19.395920 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-062dff90-ec71-440e-8901-e98bb715dbd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Returning 404 to user: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:19.395920 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-062dff90-ec71-440e-8901-e98bb715dbd1 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 404 len: 111 microversion: 2.1 time: 0.031623 Aug 30 01:18:19.395920 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 480/1004] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:18:19 2022] DELETE /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:18:19.401697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0b2b0dc9-b1e6-4520-89aa-02a14dd5e836 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:19.405283 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0b2b0dc9-b1e6-4520-89aa-02a14dd5e836 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 435521f1-f793-4834-9915-bb47962b6290] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:19.410649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b2b0dc9-b1e6-4520-89aa-02a14dd5e836 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:19.411145 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b2b0dc9-b1e6-4520-89aa-02a14dd5e836 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:19.411586 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b2b0dc9-b1e6-4520-89aa-02a14dd5e836 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:19.412302 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b2b0dc9-b1e6-4520-89aa-02a14dd5e836 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:19.412763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b2b0dc9-b1e6-4520-89aa-02a14dd5e836 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:19.413547 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b2b0dc9-b1e6-4520-89aa-02a14dd5e836 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:19.428808 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-0b2b0dc9-b1e6-4520-89aa-02a14dd5e836 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] HTTP exception thrown: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0b2b0dc9-b1e6-4520-89aa-02a14dd5e836 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Request method failure captured: Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 HTTP/1.1 Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOflXbDFJWgbl1TJC3Oy148qXhrnxQzWwozAEpLPUvBjkIue1CYn_oh9imGJ1y-bHs91DQfacqzNdoPNGJGBFUNkjPdHbXnb83IH3jbui9qUN0KpZ__R_CPwPnS8jDFUUiZ7g8Gk1RFVQFkhvoh-4PF9zh2BgfTwME3tmMd22zrKs0 Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:18:19.430520 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:18:19.438246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:19.438246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:19.438246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:19.438246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:19.438246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:19.438246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:18:19.438246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:18:19.438246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 942d175e7e2742728e66fea84c851038 Aug 30 01:18:19.438246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:19.438246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:18:19.438246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. Aug 30 01:18:19.438246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': '435521f1-f793-4834-9915-bb47962b6290'} Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:19.439525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. Aug 30 01:18:19.441086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:19.442411 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0b2b0dc9-b1e6-4520-89aa-02a14dd5e836 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Returning 404 to user: Instance 435521f1-f793-4834-9915-bb47962b6290 could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:19.442411 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0b2b0dc9-b1e6-4520-89aa-02a14dd5e836 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290" status: 404 len: 111 microversion: 2.1 time: 0.034956 Aug 30 01:18:19.442411 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 525/1005] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:19 2022] GET /compute/v2.1/servers/435521f1-f793-4834-9915-bb47962b6290 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:20.812272 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-35e339b3-d3b4-4e40-909c-e70cada2a411 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:20.812776 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-35e339b3-d3b4-4e40-909c-e70cada2a411 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:20.815298 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:20.821981 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35e339b3-d3b4-4e40-909c-e70cada2a411 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:20.826673 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35e339b3-d3b4-4e40-909c-e70cada2a411 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:20.826673 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35e339b3-d3b4-4e40-909c-e70cada2a411 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:20.826673 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35e339b3-d3b4-4e40-909c-e70cada2a411 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:20.826673 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35e339b3-d3b4-4e40-909c-e70cada2a411 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:20.827083 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35e339b3-d3b4-4e40-909c-e70cada2a411 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:20.839110 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-35e339b3-d3b4-4e40-909c-e70cada2a411 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] HTTP exception thrown: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-35e339b3-d3b4-4e40-909c-e70cada2a411 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Request method failure captured: Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 HTTP/1.1 Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWOflXbDFJWgbl1TJC3Oy148qXhrnxQzWwozAEpLPUvBjkIue1CYn_oh9imGJ1y-bHs91DQfacqzNdoPNGJGBFUNkjPdHbXnb83IH3jbui9qUN0KpZ__R_CPwPnS8jDFUUiZ7g8Gk1RFVQFkhvoh-4PF9zh2BgfTwME3tmMd22zrKs0 Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:18:20.840652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:18:20.843101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:20.843101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:20.843101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:20.843101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:20.843101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:20.843101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:18:20.843101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:18:20.843101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 942d175e7e2742728e66fea84c851038 Aug 30 01:18:20.843101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:20.843101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:18:20.843101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. Aug 30 01:18:20.843101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': '81845d9a-a800-4e7a-8edd-7d6329dd6db2'} Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:20.844082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. Aug 30 01:18:20.845753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.847551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-35e339b3-d3b4-4e40-909c-e70cada2a411 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Returning 404 to user: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:20.847551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-35e339b3-d3b4-4e40-909c-e70cada2a411 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 404 len: 111 microversion: 2.1 time: 0.035484 Aug 30 01:18:20.847551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 481/1006] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:18:20 2022] DELETE /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:20.852510 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a6aa6f42-f2f9-49d7-bf01-386145d203d2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:20.853186 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a6aa6f42-f2f9-49d7-bf01-386145d203d2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 81845d9a-a800-4e7a-8edd-7d6329dd6db2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:20.855705 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:20.861523 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a6aa6f42-f2f9-49d7-bf01-386145d203d2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:20.862040 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a6aa6f42-f2f9-49d7-bf01-386145d203d2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:20.862484 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a6aa6f42-f2f9-49d7-bf01-386145d203d2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:20.863181 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a6aa6f42-f2f9-49d7-bf01-386145d203d2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:20.863643 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a6aa6f42-f2f9-49d7-bf01-386145d203d2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:20.864094 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a6aa6f42-f2f9-49d7-bf01-386145d203d2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:20.878563 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-a6aa6f42-f2f9-49d7-bf01-386145d203d2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] HTTP exception thrown: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a6aa6f42-f2f9-49d7-bf01-386145d203d2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Request method failure captured: Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 HTTP/1.1 Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOflXbDFJWgbl1TJC3Oy148qXhrnxQzWwozAEpLPUvBjkIue1CYn_oh9imGJ1y-bHs91DQfacqzNdoPNGJGBFUNkjPdHbXnb83IH3jbui9qUN0KpZ__R_CPwPnS8jDFUUiZ7g8Gk1RFVQFkhvoh-4PF9zh2BgfTwME3tmMd22zrKs0 Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:18:20.880394 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:18:20.882017 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:20.882017 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:20.882017 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:20.882017 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:20.882017 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:20.882017 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:18:20.882017 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:18:20.882017 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 942d175e7e2742728e66fea84c851038 Aug 30 01:18:20.882017 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:20.882017 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:18:20.882017 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. Aug 30 01:18:20.882017 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': '81845d9a-a800-4e7a-8edd-7d6329dd6db2'} Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:20.882839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. Aug 30 01:18:20.884503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.890588 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a6aa6f42-f2f9-49d7-bf01-386145d203d2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Returning 404 to user: Instance 81845d9a-a800-4e7a-8edd-7d6329dd6db2 could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:20.890588 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a6aa6f42-f2f9-49d7-bf01-386145d203d2 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2" status: 404 len: 111 microversion: 2.1 time: 0.033297 Aug 30 01:18:20.890588 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 526/1007] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:20 2022] GET /compute/v2.1/servers/81845d9a-a800-4e7a-8edd-7d6329dd6db2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:20.890826 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-34daaf06-3ec2-45aa-8840-065a99c20b47 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:20.891172 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-34daaf06-3ec2-45aa-8840-065a99c20b47 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:20.899084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34daaf06-3ec2-45aa-8840-065a99c20b47 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:20.899710 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34daaf06-3ec2-45aa-8840-065a99c20b47 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:20.900156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34daaf06-3ec2-45aa-8840-065a99c20b47 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:20.900882 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34daaf06-3ec2-45aa-8840-065a99c20b47 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:20.901438 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34daaf06-3ec2-45aa-8840-065a99c20b47 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:20.901902 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34daaf06-3ec2-45aa-8840-065a99c20b47 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:20.919390 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-34daaf06-3ec2-45aa-8840-065a99c20b47 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] HTTP exception thrown: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-34daaf06-3ec2-45aa-8840-065a99c20b47 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Request method failure captured: Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 HTTP/1.1 Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWOflXbDFJWgbl1TJC3Oy148qXhrnxQzWwozAEpLPUvBjkIue1CYn_oh9imGJ1y-bHs91DQfacqzNdoPNGJGBFUNkjPdHbXnb83IH3jbui9qUN0KpZ__R_CPwPnS8jDFUUiZ7g8Gk1RFVQFkhvoh-4PF9zh2BgfTwME3tmMd22zrKs0 Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:18:20.921756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:18:20.923853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:20.923853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:20.923853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:20.923853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:20.923853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:20.923853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:18:20.923853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:18:20.923853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 942d175e7e2742728e66fea84c851038 Aug 30 01:18:20.923853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:20.923853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:18:20.923853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. Aug 30 01:18:20.923853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': '8c8307f2-8199-4ffe-aa65-ab56d819f4a1'} Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:20.924755 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. Aug 30 01:18:20.926031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.929933 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-34daaf06-3ec2-45aa-8840-065a99c20b47 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Returning 404 to user: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:20.929933 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-34daaf06-3ec2-45aa-8840-065a99c20b47 tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 404 len: 111 microversion: 2.1 time: 0.036674 Aug 30 01:18:20.929933 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 482/1008] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:18:20 2022] DELETE /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:20.944148 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-888e4bef-d21c-4a52-a189-58d99d33354c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:20.944148 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-888e4bef-d21c-4a52-a189-58d99d33354c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: 8c8307f2-8199-4ffe-aa65-ab56d819f4a1] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:20.944148 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-888e4bef-d21c-4a52-a189-58d99d33354c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:20.944148 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-888e4bef-d21c-4a52-a189-58d99d33354c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:20.944539 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-888e4bef-d21c-4a52-a189-58d99d33354c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:20.944539 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-888e4bef-d21c-4a52-a189-58d99d33354c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:20.944539 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-888e4bef-d21c-4a52-a189-58d99d33354c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:20.944809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-888e4bef-d21c-4a52-a189-58d99d33354c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:20.958397 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-888e4bef-d21c-4a52-a189-58d99d33354c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] HTTP exception thrown: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-888e4bef-d21c-4a52-a189-58d99d33354c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Request method failure captured: Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 HTTP/1.1 Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOflXbDFJWgbl1TJC3Oy148qXhrnxQzWwozAEpLPUvBjkIue1CYn_oh9imGJ1y-bHs91DQfacqzNdoPNGJGBFUNkjPdHbXnb83IH3jbui9qUN0KpZ__R_CPwPnS8jDFUUiZ7g8Gk1RFVQFkhvoh-4PF9zh2BgfTwME3tmMd22zrKs0 Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:18:20.959934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:18:20.961536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:20.961536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:20.961536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:20.961536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:20.961536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:20.961536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:18:20.961536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:18:20.961536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 942d175e7e2742728e66fea84c851038 Aug 30 01:18:20.961536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:20.961536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:18:20.961536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. Aug 30 01:18:20.961536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': '8c8307f2-8199-4ffe-aa65-ab56d819f4a1'} Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:20.962429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. Aug 30 01:18:20.963627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:20.964830 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-888e4bef-d21c-4a52-a189-58d99d33354c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Returning 404 to user: Instance 8c8307f2-8199-4ffe-aa65-ab56d819f4a1 could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:20.964830 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-888e4bef-d21c-4a52-a189-58d99d33354c tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1" status: 404 len: 111 microversion: 2.1 time: 0.029677 Aug 30 01:18:20.964830 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 527/1009] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:20 2022] GET /compute/v2.1/servers/8c8307f2-8199-4ffe-aa65-ab56d819f4a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:18:22.321952 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c7a226bf-ad5c-416b-a262-4d281f92105e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:22.322757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c7a226bf-ad5c-416b-a262-4d281f92105e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:22.328985 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7a226bf-ad5c-416b-a262-4d281f92105e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:22.329474 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7a226bf-ad5c-416b-a262-4d281f92105e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:22.329984 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7a226bf-ad5c-416b-a262-4d281f92105e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:22.330774 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7a226bf-ad5c-416b-a262-4d281f92105e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:22.331258 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7a226bf-ad5c-416b-a262-4d281f92105e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:22.331688 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7a226bf-ad5c-416b-a262-4d281f92105e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:22.346919 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-c7a226bf-ad5c-416b-a262-4d281f92105e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] HTTP exception thrown: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c7a226bf-ad5c-416b-a262-4d281f92105e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Request method failure captured: Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc HTTP/1.1 Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWOflXbDFJWgbl1TJC3Oy148qXhrnxQzWwozAEpLPUvBjkIue1CYn_oh9imGJ1y-bHs91DQfacqzNdoPNGJGBFUNkjPdHbXnb83IH3jbui9qUN0KpZ__R_CPwPnS8jDFUUiZ7g8Gk1RFVQFkhvoh-4PF9zh2BgfTwME3tmMd22zrKs0 Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:18:22.347525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:18:22.349349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:22.349349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:22.349349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:22.349349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:22.349349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:22.349349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:18:22.349349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:18:22.349349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 942d175e7e2742728e66fea84c851038 Aug 30 01:18:22.349349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:22.349349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:18:22.349349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. Aug 30 01:18:22.349349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': 'aec6af1b-90af-41d0-9778-9c0d89e330bc'} Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:22.353329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. Aug 30 01:18:22.354876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:22.356360 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c7a226bf-ad5c-416b-a262-4d281f92105e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Returning 404 to user: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:22.356360 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c7a226bf-ad5c-416b-a262-4d281f92105e tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 404 len: 111 microversion: 2.1 time: 0.031260 Aug 30 01:18:22.356360 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 483/1010] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:18:22 2022] DELETE /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:22.362023 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-814540ca-e695-4fff-97b0-bfe9eec9bf3b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:22.364395 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-814540ca-e695-4fff-97b0-bfe9eec9bf3b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] [instance: aec6af1b-90af-41d0-9778-9c0d89e330bc] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:22.370717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-814540ca-e695-4fff-97b0-bfe9eec9bf3b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:22.375535 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-814540ca-e695-4fff-97b0-bfe9eec9bf3b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:22.375535 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-814540ca-e695-4fff-97b0-bfe9eec9bf3b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:22.375535 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-814540ca-e695-4fff-97b0-bfe9eec9bf3b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:22.375535 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-814540ca-e695-4fff-97b0-bfe9eec9bf3b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:22.375968 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-814540ca-e695-4fff-97b0-bfe9eec9bf3b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:22.387001 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-814540ca-e695-4fff-97b0-bfe9eec9bf3b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] HTTP exception thrown: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-814540ca-e695-4fff-97b0-bfe9eec9bf3b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Request method failure captured: Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc HTTP/1.1 Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOflXbDFJWgbl1TJC3Oy148qXhrnxQzWwozAEpLPUvBjkIue1CYn_oh9imGJ1y-bHs91DQfacqzNdoPNGJGBFUNkjPdHbXnb83IH3jbui9qUN0KpZ__R_CPwPnS8jDFUUiZ7g8Gk1RFVQFkhvoh-4PF9zh2BgfTwME3tmMd22zrKs0 Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:18:22.388530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:18:22.390159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/11c8f48af7394a75ab6013ca066751a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:22.390159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:22.390159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 11c8f48af7394a75ab6013ca066751a7 Aug 30 01:18:22.390159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-348419005 Aug 30 01:18:22.390159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:22.390159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:18:22.390159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:18:22.390159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 942d175e7e2742728e66fea84c851038 Aug 30 01:18:22.390159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-AttachVolumeNegativeTest-348419005-project Aug 30 01:18:22.390159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:18:22.390159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. Aug 30 01:18:22.390159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': 'aec6af1b-90af-41d0-9778-9c0d89e330bc'} Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:22.390988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. Aug 30 01:18:22.392250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:22.393413 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-814540ca-e695-4fff-97b0-bfe9eec9bf3b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] Returning 404 to user: Instance aec6af1b-90af-41d0-9778-9c0d89e330bc could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:22.393413 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-814540ca-e695-4fff-97b0-bfe9eec9bf3b tempest-AttachVolumeNegativeTest-348419005 tempest-AttachVolumeNegativeTest-348419005-project] 10.222.0.52 "GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc" status: 404 len: 111 microversion: 2.1 time: 0.034980 Aug 30 01:18:22.393413 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 528/1011] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:22 2022] GET /compute/v2.1/servers/aec6af1b-90af-41d0-9778-9c0d89e330bc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:30.118032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6665b3ed-01b5-4873-beba-9d3680db655c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:30.120189 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6665b3ed-01b5-4873-beba-9d3680db655c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:30.126761 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6665b3ed-01b5-4873-beba-9d3680db655c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:30.127296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6665b3ed-01b5-4873-beba-9d3680db655c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:30.128294 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6665b3ed-01b5-4873-beba-9d3680db655c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:30.129009 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6665b3ed-01b5-4873-beba-9d3680db655c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:30.129469 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6665b3ed-01b5-4873-beba-9d3680db655c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:30.129921 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6665b3ed-01b5-4873-beba-9d3680db655c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:30.134937 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:30.166016 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6665b3ed-01b5-4873-beba-9d3680db655c tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052523 Aug 30 01:18:30.166581 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 484/1012] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Aug 30 01:18:30 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:30.234591 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-096af09b-6b44-45be-be59-1d570496ddbc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:30.235147 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-096af09b-6b44-45be-be59-1d570496ddbc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:30.242942 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-096af09b-6b44-45be-be59-1d570496ddbc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:30.243429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-096af09b-6b44-45be-be59-1d570496ddbc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:30.243857 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-096af09b-6b44-45be-be59-1d570496ddbc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:30.244544 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-096af09b-6b44-45be-be59-1d570496ddbc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:30.244995 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-096af09b-6b44-45be-be59-1d570496ddbc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:30.245416 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-096af09b-6b44-45be-be59-1d570496ddbc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:30.248306 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:30.275187 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-096af09b-6b44-45be-be59-1d570496ddbc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Going to try to terminate instance {{(pid=121233) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:18:30.626393 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-096af09b-6b44-45be-be59-1d570496ddbc tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "DELETE /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 204 len: 0 microversion: 2.20 time: 0.395445 Aug 30 01:18:30.630066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 529/1013] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Aug 30 01:18:30 2022] DELETE /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 01:18:30.635763 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bdb827ab-3123-4499-9649-f8130ed90732 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:30.636368 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bdb827ab-3123-4499-9649-f8130ed90732 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:30.642501 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdb827ab-3123-4499-9649-f8130ed90732 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:30.643053 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdb827ab-3123-4499-9649-f8130ed90732 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:30.643646 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdb827ab-3123-4499-9649-f8130ed90732 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:30.644338 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdb827ab-3123-4499-9649-f8130ed90732 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:30.644786 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdb827ab-3123-4499-9649-f8130ed90732 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:30.645204 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bdb827ab-3123-4499-9649-f8130ed90732 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:30.796627 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bdb827ab-3123-4499-9649-f8130ed90732 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:30.802401 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bdb827ab-3123-4499-9649-f8130ed90732 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:30.803850 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bdb827ab-3123-4499-9649-f8130ed90732 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:30.805029 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bdb827ab-3123-4499-9649-f8130ed90732 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.173568 Aug 30 01:18:30.805793 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 485/1014] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:18:30 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:18:31.827535 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f5491c9b-70a5-4a1e-ac36-c56b9841645b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:31.828142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f5491c9b-70a5-4a1e-ac36-c56b9841645b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:31.834874 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f5491c9b-70a5-4a1e-ac36-c56b9841645b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:31.835437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f5491c9b-70a5-4a1e-ac36-c56b9841645b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:31.835864 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f5491c9b-70a5-4a1e-ac36-c56b9841645b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:31.841987 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f5491c9b-70a5-4a1e-ac36-c56b9841645b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:31.841987 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f5491c9b-70a5-4a1e-ac36-c56b9841645b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:31.841987 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f5491c9b-70a5-4a1e-ac36-c56b9841645b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:32.008575 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f5491c9b-70a5-4a1e-ac36-c56b9841645b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:32.016740 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f5491c9b-70a5-4a1e-ac36-c56b9841645b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:32.018321 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f5491c9b-70a5-4a1e-ac36-c56b9841645b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:32.019496 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f5491c9b-70a5-4a1e-ac36-c56b9841645b tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1721 microversion: 2.20 time: 0.196278 Aug 30 01:18:32.020053 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 530/1015] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:18:31 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:18:33.043080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cd85ea90-739d-4bfe-acf3-fdc757114317 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:33.043697 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cd85ea90-739d-4bfe-acf3-fdc757114317 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:33.051044 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd85ea90-739d-4bfe-acf3-fdc757114317 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:33.051535 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd85ea90-739d-4bfe-acf3-fdc757114317 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:33.052185 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd85ea90-739d-4bfe-acf3-fdc757114317 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:33.052890 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd85ea90-739d-4bfe-acf3-fdc757114317 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:33.053513 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd85ea90-739d-4bfe-acf3-fdc757114317 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:33.054136 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd85ea90-739d-4bfe-acf3-fdc757114317 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:33.165849 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cd85ea90-739d-4bfe-acf3-fdc757114317 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:33.173181 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cd85ea90-739d-4bfe-acf3-fdc757114317 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:33.174807 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cd85ea90-739d-4bfe-acf3-fdc757114317 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:33.175998 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cd85ea90-739d-4bfe-acf3-fdc757114317 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1654 microversion: 2.20 time: 0.136824 Aug 30 01:18:33.176569 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 486/1016] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:18:33 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1654 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:18:33.598648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-109133474", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1963560351", "security_groups": [{"name": "tempest-secgroup-smoke-1209185903"}], "networks": [{"uuid": "80c77988-807f-4b63-8ab4-31648def8b2d"}], "block_device_mapping_v2": [{"uuid": "89730704-9e62-401f-93cb-b125fc9ad884", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:33.726076 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.network.neutron [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] validate_networks() for [('80c77988-807f-4b63-8ab4-31648def8b2d', None, None, None, None, None)] {{(pid=121233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:18:33.988766 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-3b1ec755-322d-4626-be6c-57496b9d9eaf req-2747403a-cbb8-47f1-ba04-b7878847281c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b743eb-1b3f-458d-ad48-d60c3934ba0d", "name": "network-vif-deleted", "tag": "adb8f445-f2e5-41a5-91ba-43406b91be88"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:33.999393 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3b1ec755-322d-4626-be6c-57496b9d9eaf req-2747403a-cbb8-47f1-ba04-b7878847281c service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:34.000299 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3b1ec755-322d-4626-be6c-57496b9d9eaf req-2747403a-cbb8-47f1-ba04-b7878847281c service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:34.000898 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3b1ec755-322d-4626-be6c-57496b9d9eaf req-2747403a-cbb8-47f1-ba04-b7878847281c service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:34.045029 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-3b1ec755-322d-4626-be6c-57496b9d9eaf req-2747403a-cbb8-47f1-ba04-b7878847281c service nova] Creating event network-vif-deleted:adb8f445-f2e5-41a5-91ba-43406b91be88 for instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d on hv-cinder-81571 Aug 30 01:18:34.071075 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-3b1ec755-322d-4626-be6c-57496b9d9eaf req-2747403a-cbb8-47f1-ba04-b7878847281c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088995 Aug 30 01:18:34.071693 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 487/1017] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:18:34.204358 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b04ade5b-f4a6-4609-80a8-d39b60a67354 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:34.205269 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b04ade5b-f4a6-4609-80a8-d39b60a67354 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:34.214848 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b04ade5b-f4a6-4609-80a8-d39b60a67354 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:34.215349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b04ade5b-f4a6-4609-80a8-d39b60a67354 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:34.215795 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b04ade5b-f4a6-4609-80a8-d39b60a67354 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:34.216520 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b04ade5b-f4a6-4609-80a8-d39b60a67354 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:34.216977 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b04ade5b-f4a6-4609-80a8-d39b60a67354 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:34.217400 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b04ade5b-f4a6-4609-80a8-d39b60a67354 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:34.345060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b04ade5b-f4a6-4609-80a8-d39b60a67354 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:34.355504 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b04ade5b-f4a6-4609-80a8-d39b60a67354 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:34.372968 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b04ade5b-f4a6-4609-80a8-d39b60a67354 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffe5c7cb44f476e913d64003105002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742c089b0dea4b1f89efd31f48f9ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:34.372968 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b04ade5b-f4a6-4609-80a8-d39b60a67354 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 200 len: 1366 microversion: 2.20 time: 0.162336 Aug 30 01:18:34.372968 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 488/1018] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:18:34 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:18:34.656126 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Flavor limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:18:34.656661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Image limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:18:34.657068 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Flavor pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:18:34.657556 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Image pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:18:34.658042 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:18:34.671366 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:34.671960 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:34.672639 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:34.673798 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:34.675036 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:34.676637 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:34.720141 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Getting quotas for project ba3bd03ea50c4553b9b98b61a4d835dd. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:18:34.728277 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Getting quotas for user 9352fbf7d98b40d7954ce1ff3d968761 and project ba3bd03ea50c4553b9b98b61a4d835dd. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:18:34.831044 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Going to run 1 instances... {{(pid=121233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:18:34.833754 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='89730704-9e62-401f-93cb-b125fc9ad884',volume_size=None,volume_type=None)] {{(pid=121233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:18:35.312413 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-76031a0b-c70e-4452-86c8-ab8e7cdf44b1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.717746 Aug 30 01:18:35.319688 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 531/1019] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:18:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:18:35.325596 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4fc922c5-4c5d-4e2f-a7a5-60dd67ed8985 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:35.326057 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4fc922c5-4c5d-4e2f-a7a5-60dd67ed8985 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:35.384202 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0ae284e5-af5c-4aa6-8fc4-bb17b0a750f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:35.384632 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4fc922c5-4c5d-4e2f-a7a5-60dd67ed8985 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:35.384890 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0ae284e5-af5c-4aa6-8fc4-bb17b0a750f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:35.391746 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0ae284e5-af5c-4aa6-8fc4-bb17b0a750f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:35.391995 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4fc922c5-4c5d-4e2f-a7a5-60dd67ed8985 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1088 microversion: 2.1 time: 0.070741 Aug 30 01:18:35.392635 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0ae284e5-af5c-4aa6-8fc4-bb17b0a750f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:35.393836 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0ae284e5-af5c-4aa6-8fc4-bb17b0a750f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:35.394245 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 489/1020] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:35 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:35.395054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0ae284e5-af5c-4aa6-8fc4-bb17b0a750f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:35.395689 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0ae284e5-af5c-4aa6-8fc4-bb17b0a750f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:35.396118 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0ae284e5-af5c-4aa6-8fc4-bb17b0a750f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:35.413296 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-0ae284e5-af5c-4aa6-8fc4-bb17b0a750f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] HTTP exception thrown: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0ae284e5-af5c-4aa6-8fc4-bb17b0a750f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Request method failure captured: Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d HTTP/1.1 Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOivkuTXOvG5D3941-UhtqEXRKlp9qTLSRyef7QzbcDzDStlPyt-TyZ9PYBXlf6OL_Z-2KInO_8p8NaBH2nPXqSsi7KL78QaKqf7qONKo3bpSQkPEoeHRsX-Jj4_b8vjC6DstRjzocFFZ3EwZvoS7ARTdCaY8dJyUhVfsybaLrsniM Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 742c089b0dea4b1f89efd31f48f9ffc5 Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:18:35.415756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:18:35.417343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:35.417343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:18:35.417343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 742c089b0dea4b1f89efd31f48f9ffc5 Aug 30 01:18:35.417343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:18:35.417343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-AttachVolumeShelveTestJSON-1371239707-project Aug 30 01:18:35.417343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:18:35.417343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:18:35.417343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 2ffe5c7cb44f476e913d64003105002c Aug 30 01:18:35.417343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1371239707-project Aug 30 01:18:35.417343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:18:35.417343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. Aug 30 01:18:35.417343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': '65b743eb-1b3f-458d-ad48-d60c3934ba0d'} Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:35.418130 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. Aug 30 01:18:35.419389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:35.421040 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0ae284e5-af5c-4aa6-8fc4-bb17b0a750f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Returning 404 to user: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:35.422387 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0ae284e5-af5c-4aa6-8fc4-bb17b0a750f4 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 404 len: 111 microversion: 2.20 time: 0.043082 Aug 30 01:18:35.424510 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 532/1021] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:18:35 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 01:18:35.438298 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-285758f7-4440-44b6-8fd4-cd236bc8ad7d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '.version_select at 0x7fd71ce75d30>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:35.537336 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-285758f7-4440-44b6-8fd4-cd236bc8ad7d tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-539486766" status: 204 len: 0 microversion: 2.20 time: 0.106140 Aug 30 01:18:35.539481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 490/1022] 10.222.0.52 () {60 vars in 1259 bytes} [Tue Aug 30 01:18:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-539486766 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 01:18:36.414148 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0d30cc6e-4e48-45e4-88a2-944ebc5cc447 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:36.415540 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0d30cc6e-4e48-45e4-88a2-944ebc5cc447 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:36.489322 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0d30cc6e-4e48-45e4-88a2-944ebc5cc447 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:36.496800 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0d30cc6e-4e48-45e4-88a2-944ebc5cc447 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1088 microversion: 2.1 time: 0.087364 Aug 30 01:18:36.497606 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 533/1023] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:36 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1088 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:37.524716 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-509ab967-6658-4578-b095-ff001fe78adf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:37.525649 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-509ab967-6658-4578-b095-ff001fe78adf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:37.531946 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-509ab967-6658-4578-b095-ff001fe78adf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:37.532440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-509ab967-6658-4578-b095-ff001fe78adf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:37.532883 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-509ab967-6658-4578-b095-ff001fe78adf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:37.534440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-509ab967-6658-4578-b095-ff001fe78adf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:37.534440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-509ab967-6658-4578-b095-ff001fe78adf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:37.534813 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-509ab967-6658-4578-b095-ff001fe78adf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:37.603557 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-509ab967-6658-4578-b095-ff001fe78adf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:37.612734 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-509ab967-6658-4578-b095-ff001fe78adf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1186 microversion: 2.1 time: 0.096569 Aug 30 01:18:37.618242 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 491/1024] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:37 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1186 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:37.750413 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-79622899-b21d-49c0-a037-7d9ef07789a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:37.751023 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-79622899-b21d-49c0-a037-7d9ef07789a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:37.759772 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-79622899-b21d-49c0-a037-7d9ef07789a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:37.760280 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-79622899-b21d-49c0-a037-7d9ef07789a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:37.760718 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-79622899-b21d-49c0-a037-7d9ef07789a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:37.761421 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-79622899-b21d-49c0-a037-7d9ef07789a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:37.761963 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-79622899-b21d-49c0-a037-7d9ef07789a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:37.762361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-79622899-b21d-49c0-a037-7d9ef07789a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:37.778138 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-79622899-b21d-49c0-a037-7d9ef07789a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] HTTP exception thrown: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-79622899-b21d-49c0-a037-7d9ef07789a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Request method failure captured: Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: DELETE /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d HTTP/1.1 Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOivkuTXOvG5D3941-UhtqEXRKlp9qTLSRyef7QzbcDzDStlPyt-TyZ9PYBXlf6OL_Z-2KInO_8p8NaBH2nPXqSsi7KL78QaKqf7qONKo3bpSQkPEoeHRsX-Jj4_b8vjC6DstRjzocFFZ3EwZvoS7ARTdCaY8dJyUhVfsybaLrsniM Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 742c089b0dea4b1f89efd31f48f9ffc5 Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:18:37.782603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:18:37.784457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:37.784457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:18:37.784457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 742c089b0dea4b1f89efd31f48f9ffc5 Aug 30 01:18:37.784457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:18:37.784457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-AttachVolumeShelveTestJSON-1371239707-project Aug 30 01:18:37.784457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:18:37.784457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:18:37.784457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 2ffe5c7cb44f476e913d64003105002c Aug 30 01:18:37.784457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1371239707-project Aug 30 01:18:37.784457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:18:37.784457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. Aug 30 01:18:37.784457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': '65b743eb-1b3f-458d-ad48-d60c3934ba0d'} Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:37.785361 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. Aug 30 01:18:37.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:37.788680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-79622899-b21d-49c0-a037-7d9ef07789a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Returning 404 to user: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:37.788680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-79622899-b21d-49c0-a037-7d9ef07789a3 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "DELETE /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 404 len: 111 microversion: 2.20 time: 0.035033 Aug 30 01:18:37.788680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 534/1025] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Aug 30 01:18:37 2022] DELETE /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 01:18:37.790375 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6d67159f-a900-4fc4-bd4a-55fc7f91b8f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:37.791023 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6d67159f-a900-4fc4-bd4a-55fc7f91b8f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: 65b743eb-1b3f-458d-ad48-d60c3934ba0d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:37.796986 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d67159f-a900-4fc4-bd4a-55fc7f91b8f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:37.797469 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d67159f-a900-4fc4-bd4a-55fc7f91b8f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:37.797957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d67159f-a900-4fc4-bd4a-55fc7f91b8f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:37.798654 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d67159f-a900-4fc4-bd4a-55fc7f91b8f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:37.799694 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d67159f-a900-4fc4-bd4a-55fc7f91b8f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:37.800111 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d67159f-a900-4fc4-bd4a-55fc7f91b8f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:37.819048 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-6d67159f-a900-4fc4-bd4a-55fc7f91b8f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] HTTP exception thrown: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6d67159f-a900-4fc4-bd4a-55fc7f91b8f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Request method failure captured: Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d HTTP/1.1 Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWOivkuTXOvG5D3941-UhtqEXRKlp9qTLSRyef7QzbcDzDStlPyt-TyZ9PYBXlf6OL_Z-2KInO_8p8NaBH2nPXqSsi7KL78QaKqf7qONKo3bpSQkPEoeHRsX-Jj4_b8vjC6DstRjzocFFZ3EwZvoS7ARTdCaY8dJyUhVfsybaLrsniM Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 742c089b0dea4b1f89efd31f48f9ffc5 Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:18:37.821032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:18:37.822719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:37.822719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:18:37.822719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 742c089b0dea4b1f89efd31f48f9ffc5 Aug 30 01:18:37.822719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:18:37.822719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeShelveTestJSON-1371239707-project Aug 30 01:18:37.822719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:18:37.822719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:18:37.822719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 2ffe5c7cb44f476e913d64003105002c Aug 30 01:18:37.822719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1371239707-project Aug 30 01:18:37.822719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:18:37.822719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. Aug 30 01:18:37.822719 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': '65b743eb-1b3f-458d-ad48-d60c3934ba0d'} Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:37.823556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. Aug 30 01:18:37.828701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:37.831457 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6d67159f-a900-4fc4-bd4a-55fc7f91b8f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Returning 404 to user: Instance 65b743eb-1b3f-458d-ad48-d60c3934ba0d could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:37.831457 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6d67159f-a900-4fc4-bd4a-55fc7f91b8f9 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d" status: 404 len: 111 microversion: 2.20 time: 0.036786 Aug 30 01:18:37.831457 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 492/1026] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:18:37 2022] GET /compute/v2.1/servers/65b743eb-1b3f-458d-ad48-d60c3934ba0d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 01:18:38.641259 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-dd16b774-b3ab-4da8-8e5e-3573d736112d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:38.641259 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-dd16b774-b3ab-4da8-8e5e-3573d736112d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:38.647080 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dd16b774-b3ab-4da8-8e5e-3573d736112d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:38.647875 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dd16b774-b3ab-4da8-8e5e-3573d736112d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:38.648457 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dd16b774-b3ab-4da8-8e5e-3573d736112d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:38.649440 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dd16b774-b3ab-4da8-8e5e-3573d736112d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:38.650098 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dd16b774-b3ab-4da8-8e5e-3573d736112d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:38.650727 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dd16b774-b3ab-4da8-8e5e-3573d736112d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:38.718340 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-dd16b774-b3ab-4da8-8e5e-3573d736112d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:38.727459 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-dd16b774-b3ab-4da8-8e5e-3573d736112d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1204 microversion: 2.1 time: 0.093490 Aug 30 01:18:38.728272 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 535/1027] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:38 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1204 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:39.231121 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-78c673d2-d128-4bd7-8ee1-e24624564f70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:39.232453 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-78c673d2-d128-4bd7-8ee1-e24624564f70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:39.240995 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78c673d2-d128-4bd7-8ee1-e24624564f70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:39.249115 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78c673d2-d128-4bd7-8ee1-e24624564f70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:39.249115 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78c673d2-d128-4bd7-8ee1-e24624564f70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:39.249115 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78c673d2-d128-4bd7-8ee1-e24624564f70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:39.249115 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78c673d2-d128-4bd7-8ee1-e24624564f70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:39.249756 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78c673d2-d128-4bd7-8ee1-e24624564f70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:39.276303 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-78c673d2-d128-4bd7-8ee1-e24624564f70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] HTTP exception thrown: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-78c673d2-d128-4bd7-8ee1-e24624564f70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Request method failure captured: Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d HTTP/1.1 Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWOivkuTXOvG5D3941-UhtqEXRKlp9qTLSRyef7QzbcDzDStlPyt-TyZ9PYBXlf6OL_Z-2KInO_8p8NaBH2nPXqSsi7KL78QaKqf7qONKo3bpSQkPEoeHRsX-Jj4_b8vjC6DstRjzocFFZ3EwZvoS7ARTdCaY8dJyUhVfsybaLrsniM Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 742c089b0dea4b1f89efd31f48f9ffc5 Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:18:39.278196 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:18:39.279918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:39.279918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:18:39.279918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 742c089b0dea4b1f89efd31f48f9ffc5 Aug 30 01:18:39.279918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:18:39.279918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeShelveTestJSON-1371239707-project Aug 30 01:18:39.279918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:18:39.279918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:18:39.279918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 2ffe5c7cb44f476e913d64003105002c Aug 30 01:18:39.279918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1371239707-project Aug 30 01:18:39.279918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:18:39.279918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. Aug 30 01:18:39.279918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': 'd4475905-983f-47fb-8b8e-6c87baeac22d'} Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:39.281050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. Aug 30 01:18:39.288514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:39.289839 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-78c673d2-d128-4bd7-8ee1-e24624564f70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Returning 404 to user: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:39.289839 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-78c673d2-d128-4bd7-8ee1-e24624564f70 tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 404 len: 111 microversion: 2.20 time: 0.053057 Aug 30 01:18:39.289839 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 493/1028] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Aug 30 01:18:39 2022] DELETE /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:18:39.301285 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-bce066f5-c455-4c93-85ac-7e18d7ae911a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:39.302459 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-bce066f5-c455-4c93-85ac-7e18d7ae911a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] [instance: d4475905-983f-47fb-8b8e-6c87baeac22d] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:39.310443 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bce066f5-c455-4c93-85ac-7e18d7ae911a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:39.311197 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bce066f5-c455-4c93-85ac-7e18d7ae911a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:39.311793 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bce066f5-c455-4c93-85ac-7e18d7ae911a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:39.312749 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bce066f5-c455-4c93-85ac-7e18d7ae911a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:39.313441 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bce066f5-c455-4c93-85ac-7e18d7ae911a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:39.314160 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bce066f5-c455-4c93-85ac-7e18d7ae911a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:39.334329 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-bce066f5-c455-4c93-85ac-7e18d7ae911a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] HTTP exception thrown: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-bce066f5-c455-4c93-85ac-7e18d7ae911a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Request method failure captured: Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d HTTP/1.1 Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWOivkuTXOvG5D3941-UhtqEXRKlp9qTLSRyef7QzbcDzDStlPyt-TyZ9PYBXlf6OL_Z-2KInO_8p8NaBH2nPXqSsi7KL78QaKqf7qONKo3bpSQkPEoeHRsX-Jj4_b8vjC6DstRjzocFFZ3EwZvoS7ARTdCaY8dJyUhVfsybaLrsniM Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 742c089b0dea4b1f89efd31f48f9ffc5 Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:18:39.342577 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:18:39.344406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/742c089b0dea4b1f89efd31f48f9ffc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:39.344406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:18:39.344406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 742c089b0dea4b1f89efd31f48f9ffc5 Aug 30 01:18:39.344406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1371239707 Aug 30 01:18:39.344406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-AttachVolumeShelveTestJSON-1371239707-project Aug 30 01:18:39.344406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:18:39.344406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:18:39.344406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 2ffe5c7cb44f476e913d64003105002c Aug 30 01:18:39.344406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1371239707-project Aug 30 01:18:39.344406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:18:39.344406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. Aug 30 01:18:39.344406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': 'd4475905-983f-47fb-8b8e-6c87baeac22d'} Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:39.345294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. Aug 30 01:18:39.346957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:39.349402 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-bce066f5-c455-4c93-85ac-7e18d7ae911a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] Returning 404 to user: Instance d4475905-983f-47fb-8b8e-6c87baeac22d could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:39.350481 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-bce066f5-c455-4c93-85ac-7e18d7ae911a tempest-AttachVolumeShelveTestJSON-1371239707 tempest-AttachVolumeShelveTestJSON-1371239707-project] 10.222.0.52 "GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d" status: 404 len: 111 microversion: 2.20 time: 0.055097 Aug 30 01:18:39.351367 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 536/1029] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 30 01:18:39 2022] GET /compute/v2.1/servers/d4475905-983f-47fb-8b8e-6c87baeac22d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:18:39.748585 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-81d86c2c-1382-4ce2-b92e-d9e2ac76d199 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:39.749678 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-81d86c2c-1382-4ce2-b92e-d9e2ac76d199 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:39.765345 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-81d86c2c-1382-4ce2-b92e-d9e2ac76d199 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:39.766864 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-81d86c2c-1382-4ce2-b92e-d9e2ac76d199 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:39.768875 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-81d86c2c-1382-4ce2-b92e-d9e2ac76d199 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:39.770397 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-81d86c2c-1382-4ce2-b92e-d9e2ac76d199 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:39.770874 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-81d86c2c-1382-4ce2-b92e-d9e2ac76d199 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:39.771306 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-81d86c2c-1382-4ce2-b92e-d9e2ac76d199 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:40.092941 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-81d86c2c-1382-4ce2-b92e-d9e2ac76d199 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:40.105473 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-81d86c2c-1382-4ce2-b92e-d9e2ac76d199 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1272 microversion: 2.1 time: 0.360340 Aug 30 01:18:40.106212 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 494/1030] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:39 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1272 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:40.305768 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-1722325c-473f-4c0b-946e-37c4a521e06b req-b8145d7e-0e78-4ea8-9980-e7269c787a5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e28fa016-241d-473f-9697-13ab6e06fa91", "tag": "c4e6504b-45ee-4446-8a10-2c25ab5d86a4"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:40.317116 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-1722325c-473f-4c0b-946e-37c4a521e06b req-b8145d7e-0e78-4ea8-9980-e7269c787a5b service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:40.317595 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-1722325c-473f-4c0b-946e-37c4a521e06b req-b8145d7e-0e78-4ea8-9980-e7269c787a5b service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:40.318047 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-1722325c-473f-4c0b-946e-37c4a521e06b req-b8145d7e-0e78-4ea8-9980-e7269c787a5b service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:40.335295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-1722325c-473f-4c0b-946e-37c4a521e06b req-b8145d7e-0e78-4ea8-9980-e7269c787a5b service nova] Creating event network-changed:c4e6504b-45ee-4446-8a10-2c25ab5d86a4 for instance e28fa016-241d-473f-9697-13ab6e06fa91 on hv-cinder-81571 Aug 30 01:18:40.340953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-1722325c-473f-4c0b-946e-37c4a521e06b req-b8145d7e-0e78-4ea8-9980-e7269c787a5b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038933 Aug 30 01:18:40.341888 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 537/1031] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:18:41.127580 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d656e21a-3111-4969-b866-84d69e9c581e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:41.129402 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d656e21a-3111-4969-b866-84d69e9c581e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:41.137448 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d656e21a-3111-4969-b866-84d69e9c581e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:41.138436 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d656e21a-3111-4969-b866-84d69e9c581e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:41.139936 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d656e21a-3111-4969-b866-84d69e9c581e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:41.147039 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d656e21a-3111-4969-b866-84d69e9c581e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:41.147854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d656e21a-3111-4969-b866-84d69e9c581e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:41.150392 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d656e21a-3111-4969-b866-84d69e9c581e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:41.404306 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d656e21a-3111-4969-b866-84d69e9c581e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:41.412414 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d656e21a-3111-4969-b866-84d69e9c581e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1260 microversion: 2.1 time: 0.289188 Aug 30 01:18:41.413274 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 495/1032] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:41 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1260 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:42.443173 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f185af54-7750-49e7-ab8f-c1169bb5e3a6 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:42.445465 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f185af54-7750-49e7-ab8f-c1169bb5e3a6 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:42.474576 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f185af54-7750-49e7-ab8f-c1169bb5e3a6 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:42.475503 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f185af54-7750-49e7-ab8f-c1169bb5e3a6 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:42.476280 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f185af54-7750-49e7-ab8f-c1169bb5e3a6 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:42.477245 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f185af54-7750-49e7-ab8f-c1169bb5e3a6 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:42.478727 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f185af54-7750-49e7-ab8f-c1169bb5e3a6 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:42.479396 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f185af54-7750-49e7-ab8f-c1169bb5e3a6 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:42.743678 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f185af54-7750-49e7-ab8f-c1169bb5e3a6 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:42.755975 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f185af54-7750-49e7-ab8f-c1169bb5e3a6 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1260 microversion: 2.1 time: 0.319919 Aug 30 01:18:42.771117 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 538/1033] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:42 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1260 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:43.777565 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-78260e38-aa57-48f5-8b52-8ec2b8fd258a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:43.778206 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-78260e38-aa57-48f5-8b52-8ec2b8fd258a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:43.784748 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78260e38-aa57-48f5-8b52-8ec2b8fd258a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:43.785236 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78260e38-aa57-48f5-8b52-8ec2b8fd258a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:43.785676 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78260e38-aa57-48f5-8b52-8ec2b8fd258a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:43.786451 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78260e38-aa57-48f5-8b52-8ec2b8fd258a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:43.787150 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78260e38-aa57-48f5-8b52-8ec2b8fd258a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:43.787856 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78260e38-aa57-48f5-8b52-8ec2b8fd258a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:43.943367 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-78260e38-aa57-48f5-8b52-8ec2b8fd258a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:43.951883 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-78260e38-aa57-48f5-8b52-8ec2b8fd258a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1260 microversion: 2.1 time: 0.178115 Aug 30 01:18:43.952474 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 496/1034] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:43 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:44.976567 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0b45055c-b79a-4f40-bf3b-57de831b9d72 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:44.977189 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0b45055c-b79a-4f40-bf3b-57de831b9d72 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:44.979794 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=2 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:44.990916 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b45055c-b79a-4f40-bf3b-57de831b9d72 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:44.990916 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b45055c-b79a-4f40-bf3b-57de831b9d72 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:44.990916 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b45055c-b79a-4f40-bf3b-57de831b9d72 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:44.990916 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b45055c-b79a-4f40-bf3b-57de831b9d72 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:44.991257 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b45055c-b79a-4f40-bf3b-57de831b9d72 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:44.991257 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0b45055c-b79a-4f40-bf3b-57de831b9d72 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:45.128734 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0b45055c-b79a-4f40-bf3b-57de831b9d72 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:45.137002 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0b45055c-b79a-4f40-bf3b-57de831b9d72 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1260 microversion: 2.1 time: 0.166706 Aug 30 01:18:45.137570 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 539/1035] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:44 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:45.620072 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:45.880999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-90714b8a-58e4-4475-a499-c0d3ddef976a tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Action: 'create', calling method: .version_select at 0x7fd71ce60af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1489019710"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:46.158908 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6eabc83a-f836-4cf0-88a1-c2b4368cf84d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:46.160369 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6eabc83a-f836-4cf0-88a1-c2b4368cf84d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:46.168151 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6eabc83a-f836-4cf0-88a1-c2b4368cf84d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:46.168623 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6eabc83a-f836-4cf0-88a1-c2b4368cf84d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:46.169216 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6eabc83a-f836-4cf0-88a1-c2b4368cf84d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:46.169946 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6eabc83a-f836-4cf0-88a1-c2b4368cf84d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:46.170413 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6eabc83a-f836-4cf0-88a1-c2b4368cf84d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:46.170838 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6eabc83a-f836-4cf0-88a1-c2b4368cf84d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:46.313412 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6eabc83a-f836-4cf0-88a1-c2b4368cf84d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:46.325668 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6eabc83a-f836-4cf0-88a1-c2b4368cf84d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1260 microversion: 2.1 time: 0.170606 Aug 30 01:18:46.326276 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 540/1036] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:46 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:46.634432 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-90714b8a-58e4-4475-a499-c0d3ddef976a tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.019879 Aug 30 01:18:46.635061 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 497/1037] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Aug 30 01:18:45 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1021 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 01:18:46.649339 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-417c866d-d503-48a7-ac77-95b1241ad2a2 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71d1a6160>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:46.659997 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=8 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:18:46.707508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-417c866d-d503-48a7-ac77-95b1241ad2a2 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd" status: 200 len: 345 microversion: 2.1 time: 0.062297 Aug 30 01:18:46.708169 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 541/1038] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 30 01:18:46 2022] GET /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:47.348559 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-84a8313e-621a-4053-978e-7f8a62c1d754 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:47.349178 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-84a8313e-621a-4053-978e-7f8a62c1d754 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:47.356671 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84a8313e-621a-4053-978e-7f8a62c1d754 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:47.357157 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84a8313e-621a-4053-978e-7f8a62c1d754 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:47.357598 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84a8313e-621a-4053-978e-7f8a62c1d754 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:47.358329 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84a8313e-621a-4053-978e-7f8a62c1d754 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:47.358788 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84a8313e-621a-4053-978e-7f8a62c1d754 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:47.359218 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-84a8313e-621a-4053-978e-7f8a62c1d754 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:47.498247 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-84a8313e-621a-4053-978e-7f8a62c1d754 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:47.506590 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-84a8313e-621a-4053-978e-7f8a62c1d754 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1260 microversion: 2.1 time: 0.162954 Aug 30 01:18:47.507093 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 498/1039] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:47 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:18:47.721096 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f84a6071-a0a9-4cd2-a837-c76e5144c1d1 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71ceaca60>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:47.771549 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f84a6071-a0a9-4cd2-a837-c76e5144c1d1 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd" status: 200 len: 346 microversion: 2.1 time: 0.054694 Aug 30 01:18:47.772115 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 542/1040] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 30 01:18:47 2022] GET /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:47.785517 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f1a10dd9-6f3e-425c-af29-8053a56d41f1 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Action: 'create', calling method: .version_select at 0x7fd71ce60430>, body: {"snapshot": {"volume_id": "f0cd3da1-e35b-44ba-b016-1e3b100763dd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-608237343"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:48.223884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f1a10dd9-6f3e-425c-af29-8053a56d41f1 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.443053 Aug 30 01:18:48.224485 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 499/1041] 10.222.0.52 () {60 vars in 1162 bytes} [Tue Aug 30 01:18:47 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:48.236527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f6241919-6ab1-44e5-9f0a-34a89d9cb3a3 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71d0b6700>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:48.274842 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f6241919-6ab1-44e5-9f0a-34a89d9cb3a3 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937" status: 200 len: 286 microversion: 2.1 time: 0.042991 Aug 30 01:18:48.275564 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 543/1042] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 30 01:18:48 2022] GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:48.293871 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5b992c82-2b30-4909-879f-494b2f3345d8 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71ced8820>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:48.321102 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5b992c82-2b30-4909-879f-494b2f3345d8 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038141 Aug 30 01:18:48.321768 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 500/1043] 10.222.0.52 () {58 vars in 1140 bytes} [Tue Aug 30 01:18:48 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:48.333035 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-8a78d8e0-f977-41e8-b97a-79af6dd04c43 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71d1a65e0>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:48.369035 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-8a78d8e0-f977-41e8-b97a-79af6dd04c43 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937" status: 200 len: 286 microversion: 2.1 time: 0.039188 Aug 30 01:18:48.369156 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 544/1044] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 30 01:18:48 2022] GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:48.528581 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-df5e5d6d-40d6-48a2-96bc-fb70c10cc5c8 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:48.529220 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-df5e5d6d-40d6-48a2-96bc-fb70c10cc5c8 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:48.535397 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df5e5d6d-40d6-48a2-96bc-fb70c10cc5c8 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:48.537166 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df5e5d6d-40d6-48a2-96bc-fb70c10cc5c8 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:48.537166 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df5e5d6d-40d6-48a2-96bc-fb70c10cc5c8 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:48.538074 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df5e5d6d-40d6-48a2-96bc-fb70c10cc5c8 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:48.538682 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df5e5d6d-40d6-48a2-96bc-fb70c10cc5c8 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:48.539115 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df5e5d6d-40d6-48a2-96bc-fb70c10cc5c8 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:48.686209 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-df5e5d6d-40d6-48a2-96bc-fb70c10cc5c8 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:48.695249 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-df5e5d6d-40d6-48a2-96bc-fb70c10cc5c8 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1260 microversion: 2.1 time: 0.171994 Aug 30 01:18:48.695832 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 501/1045] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:48 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:49.381636 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-7f00745b-716b-4ac2-b09d-1e291cb3f4ce tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71d0404c0>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:49.412772 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-7f00745b-716b-4ac2-b09d-1e291cb3f4ce tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937" status: 200 len: 286 microversion: 2.1 time: 0.034487 Aug 30 01:18:49.412893 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 545/1046] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 30 01:18:49 2022] GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:49.722721 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-626b2ef2-8464-46c9-81c0-89065a320c73 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:49.724269 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-626b2ef2-8464-46c9-81c0-89065a320c73 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:49.731053 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-626b2ef2-8464-46c9-81c0-89065a320c73 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:49.731598 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-626b2ef2-8464-46c9-81c0-89065a320c73 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:49.732041 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-626b2ef2-8464-46c9-81c0-89065a320c73 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:49.732742 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-626b2ef2-8464-46c9-81c0-89065a320c73 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:49.733201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-626b2ef2-8464-46c9-81c0-89065a320c73 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:49.733636 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-626b2ef2-8464-46c9-81c0-89065a320c73 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:49.882315 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-626b2ef2-8464-46c9-81c0-89065a320c73 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:49.890104 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-626b2ef2-8464-46c9-81c0-89065a320c73 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1260 microversion: 2.1 time: 0.171124 Aug 30 01:18:49.890612 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 502/1047] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:49 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:50.425526 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-43b15378-2e97-417f-9928-09df870334dc tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71d056940>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:50.456300 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-43b15378-2e97-417f-9928-09df870334dc tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937" status: 200 len: 286 microversion: 2.1 time: 0.035033 Aug 30 01:18:50.457056 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 546/1048] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 30 01:18:50 2022] GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:50.913306 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4959f6f8-7d8e-454f-b434-6af29ca58b63 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:50.913999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4959f6f8-7d8e-454f-b434-6af29ca58b63 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:50.922851 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4959f6f8-7d8e-454f-b434-6af29ca58b63 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:50.923350 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4959f6f8-7d8e-454f-b434-6af29ca58b63 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:50.923792 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4959f6f8-7d8e-454f-b434-6af29ca58b63 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:50.924515 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4959f6f8-7d8e-454f-b434-6af29ca58b63 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:50.924975 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4959f6f8-7d8e-454f-b434-6af29ca58b63 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:50.925405 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4959f6f8-7d8e-454f-b434-6af29ca58b63 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:51.063504 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4959f6f8-7d8e-454f-b434-6af29ca58b63 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:51.073984 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4959f6f8-7d8e-454f-b434-6af29ca58b63 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1260 microversion: 2.1 time: 0.164942 Aug 30 01:18:51.074581 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 503/1049] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:50 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:51.471179 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d88b46f0-a1bc-431c-94e9-de21bf2b9eb3 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71d0b64c0>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:51.502487 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d88b46f0-a1bc-431c-94e9-de21bf2b9eb3 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937" status: 200 len: 286 microversion: 2.1 time: 0.035599 Aug 30 01:18:51.503055 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 547/1050] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 30 01:18:51 2022] GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:52.095477 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a3d6bb5e-86d3-4ea9-ac8e-f7e6c96c16d4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:52.096088 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a3d6bb5e-86d3-4ea9-ac8e-f7e6c96c16d4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:52.102952 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3d6bb5e-86d3-4ea9-ac8e-f7e6c96c16d4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:52.103445 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3d6bb5e-86d3-4ea9-ac8e-f7e6c96c16d4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:52.103886 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3d6bb5e-86d3-4ea9-ac8e-f7e6c96c16d4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:52.104598 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3d6bb5e-86d3-4ea9-ac8e-f7e6c96c16d4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:52.105059 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3d6bb5e-86d3-4ea9-ac8e-f7e6c96c16d4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:52.105496 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3d6bb5e-86d3-4ea9-ac8e-f7e6c96c16d4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:52.255978 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a3d6bb5e-86d3-4ea9-ac8e-f7e6c96c16d4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:52.267106 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a3d6bb5e-86d3-4ea9-ac8e-f7e6c96c16d4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1260 microversion: 2.1 time: 0.175037 Aug 30 01:18:52.280959 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 504/1051] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:52 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:52.515624 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-31f4c8a4-bf06-4c00-af9f-10a05e98a00d tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71d056b80>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:52.546654 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-31f4c8a4-bf06-4c00-af9f-10a05e98a00d tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937" status: 200 len: 287 microversion: 2.1 time: 0.035325 Aug 30 01:18:52.547228 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 548/1052] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 30 01:18:52 2022] GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:52.559042 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b7b4a3ac-ce14-4d25-9094-aeec40720b0f tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71ce7c160>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:52.714221 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b7b4a3ac-ce14-4d25-9094-aeec40720b0f tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937" status: 202 len: 0 microversion: 2.1 time: 0.158976 Aug 30 01:18:52.717593 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 505/1053] 10.222.0.52 () {58 vars in 1254 bytes} [Tue Aug 30 01:18:52 2022] DELETE /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:18:52.723649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-bc873b83-9bf6-4e4a-a269-f56884c1a3d7 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71d056d30>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:52.756548 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-bc873b83-9bf6-4e4a-a269-f56884c1a3d7 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937" status: 200 len: 286 microversion: 2.1 time: 0.037030 Aug 30 01:18:52.757155 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 549/1054] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 30 01:18:52 2022] GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:18:53.289570 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-01bd5396-4647-4581-864d-81f01c72b36d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:53.290212 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-01bd5396-4647-4581-864d-81f01c72b36d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:53.296220 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01bd5396-4647-4581-864d-81f01c72b36d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:53.296709 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01bd5396-4647-4581-864d-81f01c72b36d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:53.297142 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01bd5396-4647-4581-864d-81f01c72b36d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:53.297860 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01bd5396-4647-4581-864d-81f01c72b36d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:53.298318 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01bd5396-4647-4581-864d-81f01c72b36d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:53.298746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01bd5396-4647-4581-864d-81f01c72b36d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:53.452024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-01bd5396-4647-4581-864d-81f01c72b36d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:53.459725 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-01bd5396-4647-4581-864d-81f01c72b36d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1260 microversion: 2.1 time: 0.174897 Aug 30 01:18:53.460297 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 506/1055] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:53 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:53.769639 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-db6a9340-7f97-4878-96ae-739ab038f886 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71d056430>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:53.795745 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-db6a9340-7f97-4878-96ae-739ab038f886 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] HTTP exception thrown: Snapshot c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 could not be found. Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-db6a9340-7f97-4878-96ae-739ab038f886 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Request method failure captured: Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 HTTP/1.1 Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWV1ctkhvPuFPnWoEE2pJeFV6GG2X_HiJoV9JXdqZL0xI9-yEIirCzV3fgRDjS0x6FRYwlpzb-djmeJRGy9CVE308aFI_YPISkkszX5ugYXnf261qhWbFDdYEz24ilcx7RihsWUO6Qob1YCAfwEuyRax8OibmKt-HEG0EsXdm5nT0jI Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 884db33c970a481f9badd9867fa482f1 Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1013038784 Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:18:53.798351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:18:53.799814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/884db33c970a481f9badd9867fa482f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_884db33c970a481f9badd9867fa482f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/884db33c970a481f9badd9867fa482f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/884db33c970a481f9badd9867fa482f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:53.799814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1013038784 Aug 30 01:18:53.799814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 884db33c970a481f9badd9867fa482f1 Aug 30 01:18:53.799814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1013038784 Aug 30 01:18:53.799814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-VolumesSnapshotsTestJSON-1013038784-project Aug 30 01:18:53.799814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:18:53.799814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:18:53.799814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 77e1f5c7c7cc40eea03f4cd172548761 Aug 30 01:18:53.799814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1013038784-project Aug 30 01:18:53.799814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: Aug 30 01:18:53.799814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Snapshot c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 could not be found. Aug 30 01:18:53.799814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': 'c60bdc9b-fecf-46ed-b8b3-c7fa214dd937'} Aug 30 01:18:53.799814 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 could not be found. (HTTP 404) (Request-ID: req-0c02d919-37e5-4668-960c-6a41d9d9191e) Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:53.800897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:18:53.802982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 could not be found. Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 01:18:53.804953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:53.806602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 could not be found. Aug 30 01:18:53.806602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:53.806602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:53.806602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:53.806602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:53.806602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:53.806602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:53.806602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:53.806602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:53.806602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 could not be found. Aug 30 01:18:53.806602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:53.806602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-db6a9340-7f97-4878-96ae-739ab038f886 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Returning 404 to user: Snapshot c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:53.806602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-db6a9340-7f97-4878-96ae-739ab038f886 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937" status: 404 len: 111 microversion: 2.1 time: 0.034686 Aug 30 01:18:53.807679 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 550/1056] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 30 01:18:53 2022] GET /compute/v2.1/os-snapshots/c60bdc9b-fecf-46ed-b8b3-c7fa214dd937 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:53.810518 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-198f650a-14b3-42cf-b4fd-d23ced6e7c6c tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71ce60dc0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:54.015559 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-198f650a-14b3-42cf-b4fd-d23ced6e7c6c tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd" status: 202 len: 0 microversion: 2.1 time: 0.209261 Aug 30 01:18:54.016946 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 507/1057] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 30 01:18:53 2022] DELETE /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:18:54.024837 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5c233457-d431-4f36-b929-f5c4704e9415 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71d040700>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:54.084093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5c233457-d431-4f36-b929-f5c4704e9415 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd" status: 200 len: 345 microversion: 2.1 time: 0.063061 Aug 30 01:18:54.084661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 551/1058] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 30 01:18:54 2022] GET /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:54.183551 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-db489754-9dba-4484-8e64-7590e9c444e2 req-5095cca6-9959-4228-ae8e-a562f5e35d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e28fa016-241d-473f-9697-13ab6e06fa91", "name": "network-vif-plugged", "status": "completed", "tag": "c4e6504b-45ee-4446-8a10-2c25ab5d86a4"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:54.193425 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-db489754-9dba-4484-8e64-7590e9c444e2 req-5095cca6-9959-4228-ae8e-a562f5e35d14 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:54.194010 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-db489754-9dba-4484-8e64-7590e9c444e2 req-5095cca6-9959-4228-ae8e-a562f5e35d14 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:54.194384 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-db489754-9dba-4484-8e64-7590e9c444e2 req-5095cca6-9959-4228-ae8e-a562f5e35d14 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:54.205497 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-db489754-9dba-4484-8e64-7590e9c444e2 req-5095cca6-9959-4228-ae8e-a562f5e35d14 service nova] Creating event network-vif-plugged:c4e6504b-45ee-4446-8a10-2c25ab5d86a4 for instance e28fa016-241d-473f-9697-13ab6e06fa91 on hv-cinder-81571 Aug 30 01:18:54.211534 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-db489754-9dba-4484-8e64-7590e9c444e2 req-5095cca6-9959-4228-ae8e-a562f5e35d14 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033078 Aug 30 01:18:54.212574 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 508/1059] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:18:54.480582 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-7d0b02cf-458d-4cbd-8b43-85aa5e74e8c5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:54.481901 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-7d0b02cf-458d-4cbd-8b43-85aa5e74e8c5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:54.488820 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7d0b02cf-458d-4cbd-8b43-85aa5e74e8c5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:54.489111 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7d0b02cf-458d-4cbd-8b43-85aa5e74e8c5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:54.489549 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7d0b02cf-458d-4cbd-8b43-85aa5e74e8c5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:54.490282 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7d0b02cf-458d-4cbd-8b43-85aa5e74e8c5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:54.490745 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7d0b02cf-458d-4cbd-8b43-85aa5e74e8c5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:54.491173 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7d0b02cf-458d-4cbd-8b43-85aa5e74e8c5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:54.634728 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7d0b02cf-458d-4cbd-8b43-85aa5e74e8c5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:54.642772 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-7d0b02cf-458d-4cbd-8b43-85aa5e74e8c5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1260 microversion: 2.1 time: 0.166122 Aug 30 01:18:54.643390 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 552/1060] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:54 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:55.099390 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-aafdae7a-7ed3-4a18-9cf7-f37530f67c3d tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71ced8dc0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:55.132371 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-aafdae7a-7ed3-4a18-9cf7-f37530f67c3d tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] HTTP exception thrown: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-aafdae7a-7ed3-4a18-9cf7-f37530f67c3d tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Request method failure captured: Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd HTTP/1.1 Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWV1ctkhvPuFPnWoEE2pJeFV6GG2X_HiJoV9JXdqZL0xI9-yEIirCzV3fgRDjS0x6FRYwlpzb-djmeJRGy9CVE308aFI_YPISkkszX5ugYXnf261qhWbFDdYEz24ilcx7RihsWUO6Qob1YCAfwEuyRax8OibmKt-HEG0EsXdm5nT0jI Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 884db33c970a481f9badd9867fa482f1 Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1013038784 Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:18:55.135884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:18:55.137526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/884db33c970a481f9badd9867fa482f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_884db33c970a481f9badd9867fa482f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/884db33c970a481f9badd9867fa482f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/884db33c970a481f9badd9867fa482f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:55.137526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1013038784 Aug 30 01:18:55.137526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 884db33c970a481f9badd9867fa482f1 Aug 30 01:18:55.137526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1013038784 Aug 30 01:18:55.137526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesSnapshotsTestJSON-1013038784-project Aug 30 01:18:55.137526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:18:55.137526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:18:55.137526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 77e1f5c7c7cc40eea03f4cd172548761 Aug 30 01:18:55.137526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1013038784-project Aug 30 01:18:55.137526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: Aug 30 01:18:55.137526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. Aug 30 01:18:55.137526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': 'f0cd3da1-e35b-44ba-b016-1e3b100763dd'} Aug 30 01:18:55.137526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. (HTTP 404) (Request-ID: req-9dfbae38-9685-48f7-8c7f-d20bafacc75c) Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:55.142316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:18:55.143495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 01:18:55.144669 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:55.145834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. Aug 30 01:18:55.145834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.145834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:55.145834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.145834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:55.145834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:55.145834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:55.145834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:55.145834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:55.145834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. Aug 30 01:18:55.145834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.145834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-aafdae7a-7ed3-4a18-9cf7-f37530f67c3d tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Returning 404 to user: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:55.145834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-aafdae7a-7ed3-4a18-9cf7-f37530f67c3d tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd" status: 404 len: 109 microversion: 2.1 time: 0.042329 Aug 30 01:18:55.145834 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 509/1061] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 30 01:18:55 2022] GET /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:55.148332 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-77939e73-0f34-454e-bf57-3fda0549f278 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71d1c5310>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:55.178210 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-77939e73-0f34-454e-bf57-3fda0549f278 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] HTTP exception thrown: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-77939e73-0f34-454e-bf57-3fda0549f278 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Request method failure captured: Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: DELETE /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd HTTP/1.1 Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWV1ctkhvPuFPnWoEE2pJeFV6GG2X_HiJoV9JXdqZL0xI9-yEIirCzV3fgRDjS0x6FRYwlpzb-djmeJRGy9CVE308aFI_YPISkkszX5ugYXnf261qhWbFDdYEz24ilcx7RihsWUO6Qob1YCAfwEuyRax8OibmKt-HEG0EsXdm5nT0jI Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 884db33c970a481f9badd9867fa482f1 Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1013038784 Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:18:55.181964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:18:55.183617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/884db33c970a481f9badd9867fa482f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_884db33c970a481f9badd9867fa482f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/884db33c970a481f9badd9867fa482f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/884db33c970a481f9badd9867fa482f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:55.183617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1013038784 Aug 30 01:18:55.183617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 884db33c970a481f9badd9867fa482f1 Aug 30 01:18:55.183617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1013038784 Aug 30 01:18:55.183617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-VolumesSnapshotsTestJSON-1013038784-project Aug 30 01:18:55.183617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:18:55.183617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:18:55.183617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 77e1f5c7c7cc40eea03f4cd172548761 Aug 30 01:18:55.183617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1013038784-project Aug 30 01:18:55.183617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: Aug 30 01:18:55.183617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. Aug 30 01:18:55.183617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': 'f0cd3da1-e35b-44ba-b016-1e3b100763dd'} Aug 30 01:18:55.183617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. (HTTP 404) (Request-ID: req-e2b7c145-fbe9-4a96-93d4-33bee7d7dcb4) Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:55.184648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:18:55.186389 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 01:18:55.187774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:55.189142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. Aug 30 01:18:55.189142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.189142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:55.189142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.189142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:55.189142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:55.189142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:55.189142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:55.189142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:55.189142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. Aug 30 01:18:55.189142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.189142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-77939e73-0f34-454e-bf57-3fda0549f278 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Returning 404 to user: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:55.189142 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-77939e73-0f34-454e-bf57-3fda0549f278 tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd" status: 404 len: 109 microversion: 2.1 time: 0.037358 Aug 30 01:18:55.190337 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 553/1062] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 30 01:18:55 2022] DELETE /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:55.190441 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2c952ea7-edd8-4048-933d-d0c7104a147a tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Calling method '.version_select at 0x7fd71ce081f0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:55.219687 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-2c952ea7-edd8-4048-933d-d0c7104a147a tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] HTTP exception thrown: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2c952ea7-edd8-4048-933d-d0c7104a147a tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Request method failure captured: Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd HTTP/1.1 Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWV1ctkhvPuFPnWoEE2pJeFV6GG2X_HiJoV9JXdqZL0xI9-yEIirCzV3fgRDjS0x6FRYwlpzb-djmeJRGy9CVE308aFI_YPISkkszX5ugYXnf261qhWbFDdYEz24ilcx7RihsWUO6Qob1YCAfwEuyRax8OibmKt-HEG0EsXdm5nT0jI Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 884db33c970a481f9badd9867fa482f1 Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1013038784 Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:18:55.221837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:18:55.224188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/884db33c970a481f9badd9867fa482f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_884db33c970a481f9badd9867fa482f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/884db33c970a481f9badd9867fa482f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/884db33c970a481f9badd9867fa482f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:55.224188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1013038784 Aug 30 01:18:55.224188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 884db33c970a481f9badd9867fa482f1 Aug 30 01:18:55.224188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1013038784 Aug 30 01:18:55.224188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesSnapshotsTestJSON-1013038784-project Aug 30 01:18:55.224188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:18:55.224188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:18:55.224188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 77e1f5c7c7cc40eea03f4cd172548761 Aug 30 01:18:55.224188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1013038784-project Aug 30 01:18:55.224188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: Aug 30 01:18:55.224188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. Aug 30 01:18:55.224188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': 'f0cd3da1-e35b-44ba-b016-1e3b100763dd'} Aug 30 01:18:55.224188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. (HTTP 404) (Request-ID: req-23724c98-528c-4609-8922-6214dc2e5215) Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:55.225876 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:18:55.228084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 01:18:55.229493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:55.231576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. Aug 30 01:18:55.231576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.231576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:55.231576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.231576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:55.231576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:55.231576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:55.231576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:55.231576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:55.231576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. Aug 30 01:18:55.231576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:55.231576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2c952ea7-edd8-4048-933d-d0c7104a147a tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] Returning 404 to user: Volume f0cd3da1-e35b-44ba-b016-1e3b100763dd could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:55.231576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2c952ea7-edd8-4048-933d-d0c7104a147a tempest-VolumesSnapshotsTestJSON-1013038784 tempest-VolumesSnapshotsTestJSON-1013038784-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd" status: 404 len: 109 microversion: 2.1 time: 0.037794 Aug 30 01:18:55.231576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 510/1063] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 30 01:18:55 2022] GET /compute/v2.1/os-volumes/f0cd3da1-e35b-44ba-b016-1e3b100763dd => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:55.665314 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-95e5b3c7-c38b-44dc-a666-d578f795d05a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:55.665969 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-95e5b3c7-c38b-44dc-a666-d578f795d05a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:55.672815 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95e5b3c7-c38b-44dc-a666-d578f795d05a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:55.673296 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95e5b3c7-c38b-44dc-a666-d578f795d05a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:55.673758 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95e5b3c7-c38b-44dc-a666-d578f795d05a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:55.674458 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95e5b3c7-c38b-44dc-a666-d578f795d05a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:55.674912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95e5b3c7-c38b-44dc-a666-d578f795d05a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:55.675332 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95e5b3c7-c38b-44dc-a666-d578f795d05a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:55.831001 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-95e5b3c7-c38b-44dc-a666-d578f795d05a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:55.840571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-95e5b3c7-c38b-44dc-a666-d578f795d05a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1260 microversion: 2.1 time: 0.179951 Aug 30 01:18:55.841594 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 554/1064] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:55 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:56.868021 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bfcfd689-8bd2-451b-8b66-0b07e896fc44 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:56.869489 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bfcfd689-8bd2-451b-8b66-0b07e896fc44 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:56.877301 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfcfd689-8bd2-451b-8b66-0b07e896fc44 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:56.878353 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfcfd689-8bd2-451b-8b66-0b07e896fc44 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:56.880089 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfcfd689-8bd2-451b-8b66-0b07e896fc44 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:56.881906 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfcfd689-8bd2-451b-8b66-0b07e896fc44 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:56.882754 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfcfd689-8bd2-451b-8b66-0b07e896fc44 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:56.883429 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfcfd689-8bd2-451b-8b66-0b07e896fc44 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:57.038220 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bfcfd689-8bd2-451b-8b66-0b07e896fc44 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:57.045947 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bfcfd689-8bd2-451b-8b66-0b07e896fc44 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1443 microversion: 2.1 time: 0.182862 Aug 30 01:18:57.046542 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 511/1065] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:56 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1443 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:57.068860 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-16737c4e-b0e3-4105-accc-ae4dd4587847 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:57.070060 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-16737c4e-b0e3-4105-accc-ae4dd4587847 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:18:57.080234 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-16737c4e-b0e3-4105-accc-ae4dd4587847 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:57.080735 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-16737c4e-b0e3-4105-accc-ae4dd4587847 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:57.081190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-16737c4e-b0e3-4105-accc-ae4dd4587847 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:57.082750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-16737c4e-b0e3-4105-accc-ae4dd4587847 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:57.083422 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-16737c4e-b0e3-4105-accc-ae4dd4587847 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:57.083860 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-16737c4e-b0e3-4105-accc-ae4dd4587847 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:57.236501 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-16737c4e-b0e3-4105-accc-ae4dd4587847 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:18:57.245173 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-16737c4e-b0e3-4105-accc-ae4dd4587847 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1443 microversion: 2.1 time: 0.181613 Aug 30 01:18:57.245782 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 555/1066] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:18:57 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1443 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:18:57.945483 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-64ac2ec8-c37d-4d92-94c8-0ac6f0bbf47e tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Action: 'create', calling method: .version_select at 0x7fd71ce08af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1478785339", "metadata": {"Type": "work"}}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-64ac2ec8-c37d-4d92-94c8-0ac6f0bbf47e tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Request method failure captured: Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 122 Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWWBpVZfjUQJPcmtm76jap63h2Hdw_i3n8SIiRHElMBxJqUhuDR1yjQk-HwAxF0WQRAUQGuZlxkUQAJlZD4ze6c6WZi9iCh0Q6xxbDHLUr5AjJ4Uk_8UF81r-Nv_PgM4Be5eP52XxJVtxBIgRToQwcOpreFUW0tbMRXpcZOBWyibklk Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 2ecb2b23305249c7aa6c328ef0dafc99 Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:18:57.961296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:18:57.962944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:57.962944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:57.962944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 2ecb2b23305249c7aa6c328ef0dafc99 Aug 30 01:18:57.962944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:57.962944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesNegativeTest-1575276200-project Aug 30 01:18:57.962944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:18:57.962944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:18:57.962944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 2fbbbb374d284e9b9ad2e490c7aaa1ea Aug 30 01:18:57.962944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesNegativeTest-1575276200-project Aug 30 01:18:57.962944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Aug 30 01:18:57.962944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1478785339", "metadata": {"Type": "work"}}} Aug 30 01:18:57.962944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: Aug 30 01:18:57.962944 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1478785339', 'metadata': {'Type': 'work'}}}} Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise error Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:57.963838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 01:18:57.965235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 01:18:57.966549 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 01:18:57.966549 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.966549 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-64ac2ec8-c37d-4d92-94c8-0ac6f0bbf47e tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:57.966549 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-64ac2ec8-c37d-4d92-94c8-0ac6f0bbf47e tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.145086 Aug 30 01:18:57.968927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 512/1067] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Aug 30 01:18:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:18:57.975028 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2a1aeb30-ee13-4eb4-ad51-f3b9df9bb845 tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Action: 'create', calling method: .version_select at 0x7fd71d0565e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1428988759", "metadata": {"Type": "work"}}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2a1aeb30-ee13-4eb4-ad51-f3b9df9bb845 tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Request method failure captured: Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 120 Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWWBpVZfjUQJPcmtm76jap63h2Hdw_i3n8SIiRHElMBxJqUhuDR1yjQk-HwAxF0WQRAUQGuZlxkUQAJlZD4ze6c6WZi9iCh0Q6xxbDHLUr5AjJ4Uk_8UF81r-Nv_PgM4Be5eP52XxJVtxBIgRToQwcOpreFUW0tbMRXpcZOBWyibklk Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 2ecb2b23305249c7aa6c328ef0dafc99 Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:18:57.979585 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:18:57.981019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:57.981019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:57.981019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 2ecb2b23305249c7aa6c328ef0dafc99 Aug 30 01:18:57.981019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:57.981019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-VolumesNegativeTest-1575276200-project Aug 30 01:18:57.981019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:18:57.981019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:18:57.981019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 2fbbbb374d284e9b9ad2e490c7aaa1ea Aug 30 01:18:57.981019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-VolumesNegativeTest-1575276200-project Aug 30 01:18:57.981019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Aug 30 01:18:57.981019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1428988759", "metadata": {"Type": "work"}}} Aug 30 01:18:57.981019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: Aug 30 01:18:57.981019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1428988759', 'metadata': {'Type': 'work'}}}} Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise error Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi '0' Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:57.986286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 01:18:57.987717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 01:18:57.988909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 01:18:57.988909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.988909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2a1aeb30-ee13-4eb4-ad51-f3b9df9bb845 tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:57.988909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2a1aeb30-ee13-4eb4-ad51-f3b9df9bb845 tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010998 Aug 30 01:18:57.988909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 556/1068] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Aug 30 01:18:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 01:18:57.991231 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c1a2d4c5-cfd9-49fc-b332-b0e95e3f1c3c tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Action: 'create', calling method: .version_select at 0x7fd71cddbca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1272764156", "metadata": {"Type": "work"}}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c1a2d4c5-cfd9-49fc-b332-b0e95e3f1c3c tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Request method failure captured: Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 119 Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWWBpVZfjUQJPcmtm76jap63h2Hdw_i3n8SIiRHElMBxJqUhuDR1yjQk-HwAxF0WQRAUQGuZlxkUQAJlZD4ze6c6WZi9iCh0Q6xxbDHLUr5AjJ4Uk_8UF81r-Nv_PgM4Be5eP52XxJVtxBIgRToQwcOpreFUW0tbMRXpcZOBWyibklk Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 2ecb2b23305249c7aa6c328ef0dafc99 Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:18:57.995701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:18:57.997113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:57.997113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:57.997113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 2ecb2b23305249c7aa6c328ef0dafc99 Aug 30 01:18:57.997113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:57.997113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesNegativeTest-1575276200-project Aug 30 01:18:57.997113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:18:57.997113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:18:57.997113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 2fbbbb374d284e9b9ad2e490c7aaa1ea Aug 30 01:18:57.997113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesNegativeTest-1575276200-project Aug 30 01:18:57.997113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Aug 30 01:18:57.997113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1272764156", "metadata": {"Type": "work"}}} Aug 30 01:18:57.997113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: Aug 30 01:18:57.997113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1272764156', 'metadata': {'Type': 'work'}}}} Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise error Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi '' Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:57.997999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 01:18:57.999422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 01:18:58.000594 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 01:18:58.000594 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.000594 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c1a2d4c5-cfd9-49fc-b332-b0e95e3f1c3c tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:58.000594 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c1a2d4c5-cfd9-49fc-b332-b0e95e3f1c3c tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010435 Aug 30 01:18:58.000594 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 513/1069] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Aug 30 01:18:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 01:18:58.009351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-fe0b9253-fcb3-4e2b-a9cd-8ff7dcd6cc1b tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Calling method '.version_select at 0x7fd71d1c5280>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:58.039555 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-fe0b9253-fcb3-4e2b-a9cd-8ff7dcd6cc1b tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] HTTP exception thrown: Volume tempest-invalid-2068726438 could not be found. Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-fe0b9253-fcb3-4e2b-a9cd-8ff7dcd6cc1b tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Request method failure captured: Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2068726438 HTTP/1.1 Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWWBpVZfjUQJPcmtm76jap63h2Hdw_i3n8SIiRHElMBxJqUhuDR1yjQk-HwAxF0WQRAUQGuZlxkUQAJlZD4ze6c6WZi9iCh0Q6xxbDHLUr5AjJ4Uk_8UF81r-Nv_PgM4Be5eP52XxJVtxBIgRToQwcOpreFUW0tbMRXpcZOBWyibklk Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 2ecb2b23305249c7aa6c328ef0dafc99 Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:18:58.042343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:18:58.043698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:58.043698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:58.043698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 2ecb2b23305249c7aa6c328ef0dafc99 Aug 30 01:18:58.043698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:58.043698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-VolumesNegativeTest-1575276200-project Aug 30 01:18:58.043698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:18:58.043698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:18:58.043698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 2fbbbb374d284e9b9ad2e490c7aaa1ea Aug 30 01:18:58.043698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-VolumesNegativeTest-1575276200-project Aug 30 01:18:58.043698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: Aug 30 01:18:58.043698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Volume tempest-invalid-2068726438 could not be found. Aug 30 01:18:58.043698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': 'tempest-invalid-2068726438'} Aug 30 01:18:58.043698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2068726438 could not be found. (HTTP 404) (Request-ID: req-7deb426d-b552-4e58-bfe8-26164a57e26d) Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:58.044527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:18:58.045763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2068726438 could not be found. Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:58.047841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2068726438 could not be found. Aug 30 01:18:58.050166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.050166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:58.050166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.050166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:58.050166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:58.050166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:58.050166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:58.050166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:58.050166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2068726438 could not be found. Aug 30 01:18:58.050166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.050166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-fe0b9253-fcb3-4e2b-a9cd-8ff7dcd6cc1b tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Returning 404 to user: Volume tempest-invalid-2068726438 could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:58.050166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-fe0b9253-fcb3-4e2b-a9cd-8ff7dcd6cc1b tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2068726438" status: 404 len: 99 microversion: 2.1 time: 0.038368 Aug 30 01:18:58.050166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 557/1070] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Aug 30 01:18:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2068726438 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 01:18:58.054445 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0b12dbf8-830b-4e58-b816-1b8e1fc1ab98 tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004464 Aug 30 01:18:58.058885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 514/1071] 10.222.0.52 () {58 vars in 1140 bytes} [Tue Aug 30 01:18:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 01:18:58.064005 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-fceabf1a-6e46-487a-9e49-228030c1b49e tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003759 Aug 30 01:18:58.064527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 558/1072] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Aug 30 01:18:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 01:18:58.073982 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-29a76da5-4068-4cad-9427-80e664c3c621 tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Calling method '.version_select at 0x7fd71ce08430>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:58.105629 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-29a76da5-4068-4cad-9427-80e664c3c621 tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] HTTP exception thrown: Volume 46ecf994-048a-412a-b1b6-b75654235b27 could not be found. Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-29a76da5-4068-4cad-9427-80e664c3c621 tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Request method failure captured: Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/os-volumes/46ecf994-048a-412a-b1b6-b75654235b27 HTTP/1.1 Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWWBpVZfjUQJPcmtm76jap63h2Hdw_i3n8SIiRHElMBxJqUhuDR1yjQk-HwAxF0WQRAUQGuZlxkUQAJlZD4ze6c6WZi9iCh0Q6xxbDHLUr5AjJ4Uk_8UF81r-Nv_PgM4Be5eP52XxJVtxBIgRToQwcOpreFUW0tbMRXpcZOBWyibklk Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 2ecb2b23305249c7aa6c328ef0dafc99 Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:18:58.107695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:18:58.109156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:58.109156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:58.109156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 2ecb2b23305249c7aa6c328ef0dafc99 Aug 30 01:18:58.109156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:58.109156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesNegativeTest-1575276200-project Aug 30 01:18:58.109156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:18:58.109156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:18:58.109156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 2fbbbb374d284e9b9ad2e490c7aaa1ea Aug 30 01:18:58.109156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesNegativeTest-1575276200-project Aug 30 01:18:58.109156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: Aug 30 01:18:58.109156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Volume 46ecf994-048a-412a-b1b6-b75654235b27 could not be found. Aug 30 01:18:58.109156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': '46ecf994-048a-412a-b1b6-b75654235b27'} Aug 30 01:18:58.109156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 46ecf994-048a-412a-b1b6-b75654235b27 could not be found. (HTTP 404) (Request-ID: req-e6c66044-452f-48b0-a7ff-c7c174cb499b) Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:58.110151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 01:18:58.112814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 46ecf994-048a-412a-b1b6-b75654235b27 could not be found. Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 01:18:58.115578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:58.117618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 46ecf994-048a-412a-b1b6-b75654235b27 could not be found. Aug 30 01:18:58.117618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.117618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:58.117618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.117618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:58.117618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:58.117618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:58.117618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:58.117618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:58.117618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 46ecf994-048a-412a-b1b6-b75654235b27 could not be found. Aug 30 01:18:58.117618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.117618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-29a76da5-4068-4cad-9427-80e664c3c621 tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Returning 404 to user: Volume 46ecf994-048a-412a-b1b6-b75654235b27 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:58.117618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-29a76da5-4068-4cad-9427-80e664c3c621 tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/46ecf994-048a-412a-b1b6-b75654235b27" status: 404 len: 109 microversion: 2.1 time: 0.039171 Aug 30 01:18:58.117618 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 515/1073] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 30 01:18:58 2022] DELETE /compute/v2.1/os-volumes/46ecf994-048a-412a-b1b6-b75654235b27 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:18:58.121039 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-fc843409-36f6-4ee4-84a2-45e6eb6e05e9 tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Calling method '.version_select at 0x7fd71d0b6af0>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:18:58.152918 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-fc843409-36f6-4ee4-84a2-45e6eb6e05e9 tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] HTTP exception thrown: Volume 3dc49155-7d8c-4eb2-b96e-198b2c25738e could not be found. Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-fc843409-36f6-4ee4-84a2-45e6eb6e05e9 tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Request method failure captured: Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/os-volumes/3dc49155-7d8c-4eb2-b96e-198b2c25738e HTTP/1.1 Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWWBpVZfjUQJPcmtm76jap63h2Hdw_i3n8SIiRHElMBxJqUhuDR1yjQk-HwAxF0WQRAUQGuZlxkUQAJlZD4ze6c6WZi9iCh0Q6xxbDHLUr5AjJ4Uk_8UF81r-Nv_PgM4Be5eP52XxJVtxBIgRToQwcOpreFUW0tbMRXpcZOBWyibklk Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 2ecb2b23305249c7aa6c328ef0dafc99 Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:18:58.154911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:18:58.156375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2ecb2b23305249c7aa6c328ef0dafc99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:18:58.156375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:58.156375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 2ecb2b23305249c7aa6c328ef0dafc99 Aug 30 01:18:58.156375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-VolumesNegativeTest-1575276200 Aug 30 01:18:58.156375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-VolumesNegativeTest-1575276200-project Aug 30 01:18:58.156375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:18:58.156375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:18:58.156375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 2fbbbb374d284e9b9ad2e490c7aaa1ea Aug 30 01:18:58.156375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-VolumesNegativeTest-1575276200-project Aug 30 01:18:58.156375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: Aug 30 01:18:58.156375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Volume 3dc49155-7d8c-4eb2-b96e-198b2c25738e could not be found. Aug 30 01:18:58.156375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': '3dc49155-7d8c-4eb2-b96e-198b2c25738e'} Aug 30 01:18:58.156375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3dc49155-7d8c-4eb2-b96e-198b2c25738e could not be found. (HTTP 404) (Request-ID: req-8f4613d6-f00c-44f6-a457-4093ccb49a59) Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:58.157217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 01:18:58.158506 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3dc49155-7d8c-4eb2-b96e-198b2c25738e could not be found. Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 01:18:58.159813 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:18:58.161696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3dc49155-7d8c-4eb2-b96e-198b2c25738e could not be found. Aug 30 01:18:58.161696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.161696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:18:58.161696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.161696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:18:58.161696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:18:58.161696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:18:58.161696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:18:58.161696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:18:58.161696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3dc49155-7d8c-4eb2-b96e-198b2c25738e could not be found. Aug 30 01:18:58.161696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:18:58.161696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-fc843409-36f6-4ee4-84a2-45e6eb6e05e9 tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] Returning 404 to user: Volume 3dc49155-7d8c-4eb2-b96e-198b2c25738e could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:18:58.161696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-fc843409-36f6-4ee4-84a2-45e6eb6e05e9 tempest-VolumesNegativeTest-1575276200 tempest-VolumesNegativeTest-1575276200-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/3dc49155-7d8c-4eb2-b96e-198b2c25738e" status: 404 len: 109 microversion: 2.1 time: 0.039670 Aug 30 01:18:58.161696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 559/1074] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 30 01:18:58 2022] GET /compute/v2.1/os-volumes/3dc49155-7d8c-4eb2-b96e-198b2c25738e => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:18:59.705055 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-784b91b3-1db9-402c-bd5e-65a2be862728 req-3f32130e-5532-4596-b792-b7b371fd933a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e28fa016-241d-473f-9697-13ab6e06fa91", "tag": "c4e6504b-45ee-4446-8a10-2c25ab5d86a4"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:18:59.746423 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-784b91b3-1db9-402c-bd5e-65a2be862728 req-3f32130e-5532-4596-b792-b7b371fd933a service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:18:59.746423 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-784b91b3-1db9-402c-bd5e-65a2be862728 req-3f32130e-5532-4596-b792-b7b371fd933a service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:18:59.746423 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-784b91b3-1db9-402c-bd5e-65a2be862728 req-3f32130e-5532-4596-b792-b7b371fd933a service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:18:59.746423 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-784b91b3-1db9-402c-bd5e-65a2be862728 req-3f32130e-5532-4596-b792-b7b371fd933a service nova] Creating event network-changed:c4e6504b-45ee-4446-8a10-2c25ab5d86a4 for instance e28fa016-241d-473f-9697-13ab6e06fa91 on hv-cinder-81571 Aug 30 01:18:59.752129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-784b91b3-1db9-402c-bd5e-65a2be862728 req-3f32130e-5532-4596-b792-b7b371fd933a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055727 Aug 30 01:18:59.754034 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 516/1075] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:19:45.088114 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:45.088895 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:19:45.266377 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e137a5e4-d6a5-43dc-ace6-35cc49572a58 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Action: 'create', calling method: .version_select at 0x7fd71d0325e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-399237452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkatCB3yfmMfAws1WO7IC5ktdMtj/E7rCAolk94L++6/De2irhfnqZMHIDbNEr6FokzjWtPZRpdhzasJKNiSPxzoy28zafJQzu01gHeaJVTpvKvx5ylgIgteKJioyZp0w=="}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:19:45.283139 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-e137a5e4-d6a5-43dc-ace6-35cc49572a58 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Getting quotas for project 3068817b4ca34beca8bd4da5409e58ef. Resources: {'key_pairs'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:19:45.287744 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-e137a5e4-d6a5-43dc-ace6-35cc49572a58 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Getting quotas for user b5b9eb7e61704da582a326e48e3a5170 and project 3068817b4ca34beca8bd4da5409e58ef. Resources: {'key_pairs'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:19:45.400023 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e137a5e4-d6a5-43dc-ace6-35cc49572a58 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.313062 Aug 30 01:19:45.400568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 560/1076] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 30 01:19:45 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:01.194316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:01.194316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=99 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:01.194316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 30 01:20:01.196974 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1806888724", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452", "networks": [{"uuid": "85f2aca7-11a7-421d-a0b1-55a0f1bf9d8c"}]}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:01.401818 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] validate_networks() for [('85f2aca7-11a7-421d-a0b1-55a0f1bf9d8c', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:20:01.763742 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:20:01.764161 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:20:01.764633 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:20:01.765053 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:20:01.765468 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:20:01.775642 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:01.776131 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:01.776578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:01.777309 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:01.777791 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:01.778232 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:01.797588 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Getting quotas for project 6bb93b63909346cbab03513b7707f7b8. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:20:01.801860 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Getting quotas for user 998bb52979154fdc824ec07589df82c6 and project 6bb93b63909346cbab03513b7707f7b8. Resources: {'ram', 'instances', 'cores'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:20:01.813380 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:20:01.815960 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:20:01.983577 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1e0ca153-ef4d-4f47-b00c-4820585a6d4c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796193 Aug 30 01:20:01.984229 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 517/1077] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:20:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:20:01.996444 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-197ce37d-79b7-47b3-b316-b5c2a2a3fb82 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:01.997106 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-197ce37d-79b7-47b3-b316-b5c2a2a3fb82 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:02.000739 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=4 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:02.055188 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-197ce37d-79b7-47b3-b316-b5c2a2a3fb82 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:02.063229 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-197ce37d-79b7-47b3-b316-b5c2a2a3fb82 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 200 len: 1219 microversion: 2.1 time: 0.070647 Aug 30 01:20:02.064161 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 561/1078] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:01 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:03.085686 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c6b7248a-3fa7-47f8-bfdf-b5a38c6813fd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:03.086239 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c6b7248a-3fa7-47f8-bfdf-b5a38c6813fd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:03.092418 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6b7248a-3fa7-47f8-bfdf-b5a38c6813fd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:03.092901 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6b7248a-3fa7-47f8-bfdf-b5a38c6813fd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:03.098266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6b7248a-3fa7-47f8-bfdf-b5a38c6813fd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:03.098266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6b7248a-3fa7-47f8-bfdf-b5a38c6813fd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:03.098266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6b7248a-3fa7-47f8-bfdf-b5a38c6813fd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:03.098266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6b7248a-3fa7-47f8-bfdf-b5a38c6813fd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:03.155805 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c6b7248a-3fa7-47f8-bfdf-b5a38c6813fd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:03.163791 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c6b7248a-3fa7-47f8-bfdf-b5a38c6813fd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 200 len: 1223 microversion: 2.1 time: 0.083218 Aug 30 01:20:03.164349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 518/1079] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:03 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:04.186255 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c118b74b-9781-4dc0-a8b1-e5c817650ded tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:04.186823 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c118b74b-9781-4dc0-a8b1-e5c817650ded tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:04.196303 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c118b74b-9781-4dc0-a8b1-e5c817650ded tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:04.196863 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c118b74b-9781-4dc0-a8b1-e5c817650ded tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:04.197303 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c118b74b-9781-4dc0-a8b1-e5c817650ded tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:04.198024 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c118b74b-9781-4dc0-a8b1-e5c817650ded tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:04.198481 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c118b74b-9781-4dc0-a8b1-e5c817650ded tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:04.198904 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c118b74b-9781-4dc0-a8b1-e5c817650ded tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:04.263224 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c118b74b-9781-4dc0-a8b1-e5c817650ded tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:04.270981 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c118b74b-9781-4dc0-a8b1-e5c817650ded tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 200 len: 1271 microversion: 2.1 time: 0.089720 Aug 30 01:20:04.271558 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 562/1080] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:04 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:05.292896 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4a8e6c94-fec9-459b-8e8d-dcb5cd88b82c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:05.293508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4a8e6c94-fec9-459b-8e8d-dcb5cd88b82c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:05.300271 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a8e6c94-fec9-459b-8e8d-dcb5cd88b82c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:05.300758 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a8e6c94-fec9-459b-8e8d-dcb5cd88b82c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:05.301190 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a8e6c94-fec9-459b-8e8d-dcb5cd88b82c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:05.301926 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a8e6c94-fec9-459b-8e8d-dcb5cd88b82c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:05.302391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a8e6c94-fec9-459b-8e8d-dcb5cd88b82c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:05.302794 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4a8e6c94-fec9-459b-8e8d-dcb5cd88b82c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:05.717364 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4a8e6c94-fec9-459b-8e8d-dcb5cd88b82c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:05.725411 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4a8e6c94-fec9-459b-8e8d-dcb5cd88b82c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 200 len: 1319 microversion: 2.1 time: 0.436460 Aug 30 01:20:05.737886 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 519/1081] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:05 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 1319 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:06.294151 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-0a90f7a3-25f4-4825-8044-04150259472a req-39085336-98db-4be2-ba05-b875cdc1167b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efeb4c87-61e6-4f02-a63a-b08aa0f825b2", "tag": "fa5bce71-7c73-45dd-98d6-e1ca6af10991"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:06.312525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-0a90f7a3-25f4-4825-8044-04150259472a req-39085336-98db-4be2-ba05-b875cdc1167b service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:06.313010 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-0a90f7a3-25f4-4825-8044-04150259472a req-39085336-98db-4be2-ba05-b875cdc1167b service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:06.313443 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-0a90f7a3-25f4-4825-8044-04150259472a req-39085336-98db-4be2-ba05-b875cdc1167b service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:06.326532 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-0a90f7a3-25f4-4825-8044-04150259472a req-39085336-98db-4be2-ba05-b875cdc1167b service nova] Creating event network-changed:fa5bce71-7c73-45dd-98d6-e1ca6af10991 for instance efeb4c87-61e6-4f02-a63a-b08aa0f825b2 on hv-cinder-81571 Aug 30 01:20:06.331433 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-0a90f7a3-25f4-4825-8044-04150259472a req-39085336-98db-4be2-ba05-b875cdc1167b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040965 Aug 30 01:20:06.332042 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 563/1082] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:06.748507 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8ee75284-682c-4462-ae7b-5ca8d083b161 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:06.749813 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8ee75284-682c-4462-ae7b-5ca8d083b161 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:06.758809 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ee75284-682c-4462-ae7b-5ca8d083b161 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:06.759588 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ee75284-682c-4462-ae7b-5ca8d083b161 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:06.760229 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ee75284-682c-4462-ae7b-5ca8d083b161 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:06.761142 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ee75284-682c-4462-ae7b-5ca8d083b161 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:06.761787 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ee75284-682c-4462-ae7b-5ca8d083b161 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:06.762384 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8ee75284-682c-4462-ae7b-5ca8d083b161 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:06.979070 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-946539376", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-399237452", "security_groups": [{"name": "tempest-secgroup-smoke-1826305638"}], "block_device_mapping_v2": [{"uuid": "b4edce21-fd13-4046-a82b-0c9ff87ca5c6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8c6152a9-22c5-47c3-b922-7c52df366312"}]}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:07.020306 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8ee75284-682c-4462-ae7b-5ca8d083b161 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:07.033877 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8ee75284-682c-4462-ae7b-5ca8d083b161 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 200 len: 1319 microversion: 2.1 time: 0.289796 Aug 30 01:20:07.034830 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 520/1083] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:06 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:07.102012 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.network.neutron [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] validate_networks() for [('8c6152a9-22c5-47c3-b922-7c52df366312', None, None, None, None, None)] {{(pid=121233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:20:07.480865 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Flavor limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:20:07.481429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Image limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:20:07.481786 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Flavor pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:20:07.482207 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Image pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:20:07.482660 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:20:07.493046 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:07.493539 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:07.494015 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:07.494755 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:07.495217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:07.495652 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:07.526438 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Getting quotas for project 3068817b4ca34beca8bd4da5409e58ef. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:20:07.531895 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Getting quotas for user b5b9eb7e61704da582a326e48e3a5170 and project 3068817b4ca34beca8bd4da5409e58ef. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:20:07.591937 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Going to run 1 instances... {{(pid=121233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:20:07.594302 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b4edce21-fd13-4046-a82b-0c9ff87ca5c6',volume_size=None,volume_type=None)] {{(pid=121233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:20:08.011213 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-3a0b3b06-df27-4008-851f-22e13c9aab33 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.037105 Aug 30 01:20:08.011876 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 564/1084] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:20:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:20:08.022730 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1019a1c2-6827-4859-a907-8eb336557026 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:08.024094 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1019a1c2-6827-4859-a907-8eb336557026 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:08.056050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5fc90e2a-71f0-4148-a80c-04e0fc2c88a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:08.056779 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5fc90e2a-71f0-4148-a80c-04e0fc2c88a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:08.065568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fc90e2a-71f0-4148-a80c-04e0fc2c88a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:08.066110 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fc90e2a-71f0-4148-a80c-04e0fc2c88a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:08.066555 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fc90e2a-71f0-4148-a80c-04e0fc2c88a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:08.067269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fc90e2a-71f0-4148-a80c-04e0fc2c88a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:08.067729 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fc90e2a-71f0-4148-a80c-04e0fc2c88a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:08.068158 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fc90e2a-71f0-4148-a80c-04e0fc2c88a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:08.080524 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1019a1c2-6827-4859-a907-8eb336557026 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:08.088150 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1019a1c2-6827-4859-a907-8eb336557026 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1093 microversion: 2.1 time: 0.069219 Aug 30 01:20:08.088727 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 521/1085] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:08 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:08.220404 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5fc90e2a-71f0-4148-a80c-04e0fc2c88a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:08.229294 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5fc90e2a-71f0-4148-a80c-04e0fc2c88a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 200 len: 1319 microversion: 2.1 time: 0.176943 Aug 30 01:20:08.229933 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 565/1086] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:08 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:09.108400 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b5fb97d9-ce96-4496-865a-bff15373f275 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:09.109118 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b5fb97d9-ce96-4496-865a-bff15373f275 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:09.116472 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5fb97d9-ce96-4496-865a-bff15373f275 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:09.117624 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5fb97d9-ce96-4496-865a-bff15373f275 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:09.120796 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5fb97d9-ce96-4496-865a-bff15373f275 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:09.120796 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5fb97d9-ce96-4496-865a-bff15373f275 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:09.120796 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5fb97d9-ce96-4496-865a-bff15373f275 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:09.120796 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5fb97d9-ce96-4496-865a-bff15373f275 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:09.179521 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b5fb97d9-ce96-4496-865a-bff15373f275 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:09.187959 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b5fb97d9-ce96-4496-865a-bff15373f275 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1143 microversion: 2.1 time: 0.083428 Aug 30 01:20:09.188529 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 522/1087] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:09 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:09.258058 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-95492562-5b07-4f6f-8fa0-a92472cca0a9 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:09.258957 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-95492562-5b07-4f6f-8fa0-a92472cca0a9 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:09.265705 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95492562-5b07-4f6f-8fa0-a92472cca0a9 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:09.266215 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95492562-5b07-4f6f-8fa0-a92472cca0a9 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:09.266649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95492562-5b07-4f6f-8fa0-a92472cca0a9 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:09.267340 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95492562-5b07-4f6f-8fa0-a92472cca0a9 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:09.267788 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95492562-5b07-4f6f-8fa0-a92472cca0a9 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:09.268206 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95492562-5b07-4f6f-8fa0-a92472cca0a9 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:09.398920 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-95492562-5b07-4f6f-8fa0-a92472cca0a9 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:09.407252 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-95492562-5b07-4f6f-8fa0-a92472cca0a9 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 200 len: 1319 microversion: 2.1 time: 0.153015 Aug 30 01:20:09.407831 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 566/1088] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:09 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:10.208941 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-323fe043-b4ab-4a1c-bd85-11fd08c10529 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:10.209832 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-323fe043-b4ab-4a1c-bd85-11fd08c10529 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:10.217132 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-323fe043-b4ab-4a1c-bd85-11fd08c10529 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:10.217798 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-323fe043-b4ab-4a1c-bd85-11fd08c10529 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:10.218251 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-323fe043-b4ab-4a1c-bd85-11fd08c10529 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:10.218957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-323fe043-b4ab-4a1c-bd85-11fd08c10529 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:10.219419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-323fe043-b4ab-4a1c-bd85-11fd08c10529 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:10.219853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-323fe043-b4ab-4a1c-bd85-11fd08c10529 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:10.288506 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-323fe043-b4ab-4a1c-bd85-11fd08c10529 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:10.312112 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-323fe043-b4ab-4a1c-bd85-11fd08c10529 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1191 microversion: 2.1 time: 0.107095 Aug 30 01:20:10.312721 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 523/1089] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:10 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1191 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:10.428482 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-a40abece-f1c0-46f5-a5a0-5976af19b60e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:10.429055 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-a40abece-f1c0-46f5-a5a0-5976af19b60e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:10.435980 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a40abece-f1c0-46f5-a5a0-5976af19b60e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:10.436465 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a40abece-f1c0-46f5-a5a0-5976af19b60e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:10.436905 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a40abece-f1c0-46f5-a5a0-5976af19b60e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:10.440898 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a40abece-f1c0-46f5-a5a0-5976af19b60e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:10.440898 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a40abece-f1c0-46f5-a5a0-5976af19b60e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:10.440898 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-a40abece-f1c0-46f5-a5a0-5976af19b60e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:10.581064 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-a40abece-f1c0-46f5-a5a0-5976af19b60e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:10.589976 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-a40abece-f1c0-46f5-a5a0-5976af19b60e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 200 len: 1319 microversion: 2.1 time: 0.165399 Aug 30 01:20:10.590562 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 567/1090] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:10 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:11.332599 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6185d71b-cb6f-4527-915c-3fdc4a7646dd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:11.333446 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6185d71b-cb6f-4527-915c-3fdc4a7646dd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:11.343030 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6185d71b-cb6f-4527-915c-3fdc4a7646dd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:11.343712 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6185d71b-cb6f-4527-915c-3fdc4a7646dd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:11.344444 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6185d71b-cb6f-4527-915c-3fdc4a7646dd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:11.345499 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6185d71b-cb6f-4527-915c-3fdc4a7646dd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:11.345988 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6185d71b-cb6f-4527-915c-3fdc4a7646dd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:11.351907 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6185d71b-cb6f-4527-915c-3fdc4a7646dd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:11.514020 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6185d71b-cb6f-4527-915c-3fdc4a7646dd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:11.523504 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6185d71b-cb6f-4527-915c-3fdc4a7646dd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1277 microversion: 2.1 time: 0.194795 Aug 30 01:20:11.524395 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 524/1091] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:11 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:11.612493 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-59296ea0-7c00-4627-8f46-63d05c07a620 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:11.613150 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-59296ea0-7c00-4627-8f46-63d05c07a620 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:11.624912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-59296ea0-7c00-4627-8f46-63d05c07a620 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:11.626166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-59296ea0-7c00-4627-8f46-63d05c07a620 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:11.627054 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-59296ea0-7c00-4627-8f46-63d05c07a620 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:11.628409 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-59296ea0-7c00-4627-8f46-63d05c07a620 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:11.629409 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-59296ea0-7c00-4627-8f46-63d05c07a620 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:11.630405 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-59296ea0-7c00-4627-8f46-63d05c07a620 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:11.767045 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-93b97992-c2bb-44e8-ac06-a50022429835 req-44859a6c-394e-4efb-928a-34dfe9f2191e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efeb4c87-61e6-4f02-a63a-b08aa0f825b2", "name": "network-vif-plugged", "status": "completed", "tag": "fa5bce71-7c73-45dd-98d6-e1ca6af10991"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:11.777451 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-93b97992-c2bb-44e8-ac06-a50022429835 req-44859a6c-394e-4efb-928a-34dfe9f2191e service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:11.778333 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-93b97992-c2bb-44e8-ac06-a50022429835 req-44859a6c-394e-4efb-928a-34dfe9f2191e service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:11.779038 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-93b97992-c2bb-44e8-ac06-a50022429835 req-44859a6c-394e-4efb-928a-34dfe9f2191e service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:11.790203 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:11.792698 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-93b97992-c2bb-44e8-ac06-a50022429835 req-44859a6c-394e-4efb-928a-34dfe9f2191e service nova] Creating event network-vif-plugged:fa5bce71-7c73-45dd-98d6-e1ca6af10991 for instance efeb4c87-61e6-4f02-a63a-b08aa0f825b2 on hv-cinder-81571 Aug 30 01:20:11.798163 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-93b97992-c2bb-44e8-ac06-a50022429835 req-44859a6c-394e-4efb-928a-34dfe9f2191e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034693 Aug 30 01:20:11.801762 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 525/1092] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:11.802415 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-59296ea0-7c00-4627-8f46-63d05c07a620 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:11.811029 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-59296ea0-7c00-4627-8f46-63d05c07a620 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 200 len: 1319 microversion: 2.1 time: 0.204418 Aug 30 01:20:11.811600 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 568/1093] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:11 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:12.375968 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-d8b31fb1-1ed2-4854-87d1-9c383a6e4763 req-f8f54585-aee8-45a2-ae18-70ba628a62fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9", "tag": "fd271197-9d24-4e46-858e-e54a62ef8533"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:12.385854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d8b31fb1-1ed2-4854-87d1-9c383a6e4763 req-f8f54585-aee8-45a2-ae18-70ba628a62fa service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:12.386988 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d8b31fb1-1ed2-4854-87d1-9c383a6e4763 req-f8f54585-aee8-45a2-ae18-70ba628a62fa service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:12.387195 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d8b31fb1-1ed2-4854-87d1-9c383a6e4763 req-f8f54585-aee8-45a2-ae18-70ba628a62fa service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:12.398950 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-d8b31fb1-1ed2-4854-87d1-9c383a6e4763 req-f8f54585-aee8-45a2-ae18-70ba628a62fa service nova] Creating event network-changed:fd271197-9d24-4e46-858e-e54a62ef8533 for instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 on hv-cinder-81571 Aug 30 01:20:12.404911 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-d8b31fb1-1ed2-4854-87d1-9c383a6e4763 req-f8f54585-aee8-45a2-ae18-70ba628a62fa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033368 Aug 30 01:20:12.405832 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 526/1094] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:12.546367 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2e65a7e4-59b2-42c2-af3f-f3a560bf468d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:12.546983 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2e65a7e4-59b2-42c2-af3f-f3a560bf468d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:12.552996 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e65a7e4-59b2-42c2-af3f-f3a560bf468d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:12.553409 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e65a7e4-59b2-42c2-af3f-f3a560bf468d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:12.553868 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e65a7e4-59b2-42c2-af3f-f3a560bf468d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:12.554547 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e65a7e4-59b2-42c2-af3f-f3a560bf468d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:12.555066 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e65a7e4-59b2-42c2-af3f-f3a560bf468d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:12.555419 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2e65a7e4-59b2-42c2-af3f-f3a560bf468d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:12.686421 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2e65a7e4-59b2-42c2-af3f-f3a560bf468d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:12.694500 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2e65a7e4-59b2-42c2-af3f-f3a560bf468d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1265 microversion: 2.1 time: 0.152034 Aug 30 01:20:12.695077 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 569/1095] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:12 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:12.833016 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5bc8ac82-c0ff-468f-aa87-c631210182d3 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:12.833641 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5bc8ac82-c0ff-468f-aa87-c631210182d3 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:12.840795 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bc8ac82-c0ff-468f-aa87-c631210182d3 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:12.841282 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bc8ac82-c0ff-468f-aa87-c631210182d3 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:12.841723 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bc8ac82-c0ff-468f-aa87-c631210182d3 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:12.842560 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bc8ac82-c0ff-468f-aa87-c631210182d3 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:12.843025 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bc8ac82-c0ff-468f-aa87-c631210182d3 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:12.843456 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bc8ac82-c0ff-468f-aa87-c631210182d3 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:12.974327 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5bc8ac82-c0ff-468f-aa87-c631210182d3 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:12.982477 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5bc8ac82-c0ff-468f-aa87-c631210182d3 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 200 len: 1319 microversion: 2.1 time: 0.153722 Aug 30 01:20:12.983052 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 527/1096] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:12 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:13.717021 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-bb110fcf-f4a9-458b-8f82-721f0dfd3ecf tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:13.717667 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-bb110fcf-f4a9-458b-8f82-721f0dfd3ecf tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:13.724703 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bb110fcf-f4a9-458b-8f82-721f0dfd3ecf tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:13.725198 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bb110fcf-f4a9-458b-8f82-721f0dfd3ecf tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:13.725642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bb110fcf-f4a9-458b-8f82-721f0dfd3ecf tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:13.726410 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bb110fcf-f4a9-458b-8f82-721f0dfd3ecf tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:13.726873 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bb110fcf-f4a9-458b-8f82-721f0dfd3ecf tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:13.727300 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bb110fcf-f4a9-458b-8f82-721f0dfd3ecf tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:13.876015 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-bb110fcf-f4a9-458b-8f82-721f0dfd3ecf tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:13.883835 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-bb110fcf-f4a9-458b-8f82-721f0dfd3ecf tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1265 microversion: 2.1 time: 0.171498 Aug 30 01:20:13.884408 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 570/1097] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:13 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:14.003766 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-024dce2b-70fc-42da-8aa1-e17150b62990 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:14.004567 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-024dce2b-70fc-42da-8aa1-e17150b62990 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:14.010877 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-024dce2b-70fc-42da-8aa1-e17150b62990 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:14.011372 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-024dce2b-70fc-42da-8aa1-e17150b62990 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:14.011819 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-024dce2b-70fc-42da-8aa1-e17150b62990 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:14.012523 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-024dce2b-70fc-42da-8aa1-e17150b62990 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:14.013171 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-024dce2b-70fc-42da-8aa1-e17150b62990 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:14.013665 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-024dce2b-70fc-42da-8aa1-e17150b62990 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:14.234348 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-024dce2b-70fc-42da-8aa1-e17150b62990 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:14.242154 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-024dce2b-70fc-42da-8aa1-e17150b62990 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 200 len: 1319 microversion: 2.1 time: 0.242227 Aug 30 01:20:14.242731 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 528/1098] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:13 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:14.904643 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b096aacb-6c7b-44d3-b9e5-2cbb70ed5e42 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:14.905238 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b096aacb-6c7b-44d3-b9e5-2cbb70ed5e42 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:14.911912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b096aacb-6c7b-44d3-b9e5-2cbb70ed5e42 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:14.912387 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b096aacb-6c7b-44d3-b9e5-2cbb70ed5e42 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:14.912817 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b096aacb-6c7b-44d3-b9e5-2cbb70ed5e42 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:14.913493 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b096aacb-6c7b-44d3-b9e5-2cbb70ed5e42 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:14.913976 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b096aacb-6c7b-44d3-b9e5-2cbb70ed5e42 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:14.914397 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b096aacb-6c7b-44d3-b9e5-2cbb70ed5e42 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:15.046221 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-b096aacb-6c7b-44d3-b9e5-2cbb70ed5e42 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:15.054006 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-b096aacb-6c7b-44d3-b9e5-2cbb70ed5e42 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1265 microversion: 2.1 time: 0.153228 Aug 30 01:20:15.054580 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 571/1099] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:14 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:15.267174 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d41faf38-b418-469a-8c7f-f3c91466d367 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:15.267796 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d41faf38-b418-469a-8c7f-f3c91466d367 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:15.275132 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d41faf38-b418-469a-8c7f-f3c91466d367 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:15.275621 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d41faf38-b418-469a-8c7f-f3c91466d367 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:15.276537 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d41faf38-b418-469a-8c7f-f3c91466d367 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:15.277505 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d41faf38-b418-469a-8c7f-f3c91466d367 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:15.278017 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d41faf38-b418-469a-8c7f-f3c91466d367 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:15.278479 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d41faf38-b418-469a-8c7f-f3c91466d367 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:15.416369 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d41faf38-b418-469a-8c7f-f3c91466d367 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:15.424881 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d41faf38-b418-469a-8c7f-f3c91466d367 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 200 len: 1507 microversion: 2.1 time: 0.165061 Aug 30 01:20:15.425448 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 529/1100] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:15 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:16.075134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-2bda1ade-da0b-41ad-9fdb-eaff0afea35e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:16.075745 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-2bda1ade-da0b-41ad-9fdb-eaff0afea35e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:16.082356 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2bda1ade-da0b-41ad-9fdb-eaff0afea35e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:16.082835 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2bda1ade-da0b-41ad-9fdb-eaff0afea35e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:16.083269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2bda1ade-da0b-41ad-9fdb-eaff0afea35e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:16.083951 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2bda1ade-da0b-41ad-9fdb-eaff0afea35e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:16.084402 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2bda1ade-da0b-41ad-9fdb-eaff0afea35e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:16.084824 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-2bda1ade-da0b-41ad-9fdb-eaff0afea35e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:16.224191 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-2bda1ade-da0b-41ad-9fdb-eaff0afea35e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:16.232712 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-2bda1ade-da0b-41ad-9fdb-eaff0afea35e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1265 microversion: 2.1 time: 0.161556 Aug 30 01:20:16.233286 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 572/1101] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:16 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:17.253335 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-289412da-c0cc-40b9-a0f0-f8fe0b73bc8b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:17.254130 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-289412da-c0cc-40b9-a0f0-f8fe0b73bc8b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:17.261769 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-289412da-c0cc-40b9-a0f0-f8fe0b73bc8b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:17.262332 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-289412da-c0cc-40b9-a0f0-f8fe0b73bc8b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:17.263030 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-289412da-c0cc-40b9-a0f0-f8fe0b73bc8b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:17.263983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-289412da-c0cc-40b9-a0f0-f8fe0b73bc8b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:17.264619 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-289412da-c0cc-40b9-a0f0-f8fe0b73bc8b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:17.265307 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-289412da-c0cc-40b9-a0f0-f8fe0b73bc8b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:17.401343 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-289412da-c0cc-40b9-a0f0-f8fe0b73bc8b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:17.409407 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-289412da-c0cc-40b9-a0f0-f8fe0b73bc8b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1265 microversion: 2.1 time: 0.159923 Aug 30 01:20:17.410318 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 530/1102] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:17 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:20:18.432661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-93a73b2d-8efe-4285-bb5a-e6174a93ccd8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:18.433302 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-93a73b2d-8efe-4285-bb5a-e6174a93ccd8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:18.435776 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=2 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:18.436451 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=8 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:18.441999 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-93a73b2d-8efe-4285-bb5a-e6174a93ccd8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:18.442494 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-93a73b2d-8efe-4285-bb5a-e6174a93ccd8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:18.442958 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-93a73b2d-8efe-4285-bb5a-e6174a93ccd8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:18.443632 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-93a73b2d-8efe-4285-bb5a-e6174a93ccd8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:18.444082 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-93a73b2d-8efe-4285-bb5a-e6174a93ccd8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:18.444504 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-93a73b2d-8efe-4285-bb5a-e6174a93ccd8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:18.595435 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-93a73b2d-8efe-4285-bb5a-e6174a93ccd8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:18.603561 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-93a73b2d-8efe-4285-bb5a-e6174a93ccd8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1265 microversion: 2.1 time: 0.175316 Aug 30 01:20:18.604821 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 573/1103] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:18 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:19.624803 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dab28a94-12f4-4e96-b4d6-509fdef522f9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:19.625362 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dab28a94-12f4-4e96-b4d6-509fdef522f9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:19.627246 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=8 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:19.632926 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dab28a94-12f4-4e96-b4d6-509fdef522f9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:19.638007 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dab28a94-12f4-4e96-b4d6-509fdef522f9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:19.638007 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dab28a94-12f4-4e96-b4d6-509fdef522f9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:19.638007 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dab28a94-12f4-4e96-b4d6-509fdef522f9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:19.638007 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dab28a94-12f4-4e96-b4d6-509fdef522f9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:19.638440 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dab28a94-12f4-4e96-b4d6-509fdef522f9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:19.778201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dab28a94-12f4-4e96-b4d6-509fdef522f9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:19.786358 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dab28a94-12f4-4e96-b4d6-509fdef522f9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1265 microversion: 2.1 time: 0.165648 Aug 30 01:20:19.786924 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 531/1104] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:19 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:20.806993 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-27e2d7b7-237f-4835-aff4-b26bb13590b3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:20.807741 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-27e2d7b7-237f-4835-aff4-b26bb13590b3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:20.815427 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27e2d7b7-237f-4835-aff4-b26bb13590b3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:20.816058 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27e2d7b7-237f-4835-aff4-b26bb13590b3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:20.816601 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27e2d7b7-237f-4835-aff4-b26bb13590b3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:20.817385 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27e2d7b7-237f-4835-aff4-b26bb13590b3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:20.817886 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27e2d7b7-237f-4835-aff4-b26bb13590b3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:20.818321 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-27e2d7b7-237f-4835-aff4-b26bb13590b3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:20.957601 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-27e2d7b7-237f-4835-aff4-b26bb13590b3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:20.966027 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-27e2d7b7-237f-4835-aff4-b26bb13590b3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1265 microversion: 2.1 time: 0.163000 Aug 30 01:20:20.966586 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 574/1105] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:20 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:21.987358 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f3e562fe-8990-40bd-b7a1-7bf41c1e1904 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:21.988025 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f3e562fe-8990-40bd-b7a1-7bf41c1e1904 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:21.995156 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3e562fe-8990-40bd-b7a1-7bf41c1e1904 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:21.995880 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3e562fe-8990-40bd-b7a1-7bf41c1e1904 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:21.996493 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3e562fe-8990-40bd-b7a1-7bf41c1e1904 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:21.997220 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3e562fe-8990-40bd-b7a1-7bf41c1e1904 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:21.997685 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3e562fe-8990-40bd-b7a1-7bf41c1e1904 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:21.998263 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3e562fe-8990-40bd-b7a1-7bf41c1e1904 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:22.134782 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f3e562fe-8990-40bd-b7a1-7bf41c1e1904 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:22.142600 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f3e562fe-8990-40bd-b7a1-7bf41c1e1904 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1265 microversion: 2.1 time: 0.159215 Aug 30 01:20:22.143176 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 532/1106] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:21 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:23.163491 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6893f978-b61d-48fe-abd9-7bd69391900f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:23.164108 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6893f978-b61d-48fe-abd9-7bd69391900f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:23.171084 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6893f978-b61d-48fe-abd9-7bd69391900f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:23.171571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6893f978-b61d-48fe-abd9-7bd69391900f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:23.172019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6893f978-b61d-48fe-abd9-7bd69391900f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:23.172723 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6893f978-b61d-48fe-abd9-7bd69391900f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:23.173184 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6893f978-b61d-48fe-abd9-7bd69391900f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:23.173613 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6893f978-b61d-48fe-abd9-7bd69391900f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:23.314236 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6893f978-b61d-48fe-abd9-7bd69391900f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:23.318800 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6893f978-b61d-48fe-abd9-7bd69391900f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1265 microversion: 2.1 time: 0.159729 Aug 30 01:20:23.319383 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 575/1107] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:23 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:23.832446 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-7a44e3af-89bf-4880-854f-1824fda39656 req-bd95e4ca-9e3b-4ce0-95ea-380553ab205f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9", "name": "network-vif-plugged", "status": "completed", "tag": "fd271197-9d24-4e46-858e-e54a62ef8533"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:23.843882 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-7a44e3af-89bf-4880-854f-1824fda39656 req-bd95e4ca-9e3b-4ce0-95ea-380553ab205f service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:23.844363 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-7a44e3af-89bf-4880-854f-1824fda39656 req-bd95e4ca-9e3b-4ce0-95ea-380553ab205f service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:23.844800 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-7a44e3af-89bf-4880-854f-1824fda39656 req-bd95e4ca-9e3b-4ce0-95ea-380553ab205f service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:23.857418 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-7a44e3af-89bf-4880-854f-1824fda39656 req-bd95e4ca-9e3b-4ce0-95ea-380553ab205f service nova] Creating event network-vif-plugged:fd271197-9d24-4e46-858e-e54a62ef8533 for instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 on hv-cinder-81571 Aug 30 01:20:23.862619 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-7a44e3af-89bf-4880-854f-1824fda39656 req-bd95e4ca-9e3b-4ce0-95ea-380553ab205f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034287 Aug 30 01:20:23.863265 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 533/1108] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:24.340504 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-359c9767-968a-4637-8004-648c90f4f9f4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:24.344145 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-359c9767-968a-4637-8004-648c90f4f9f4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:24.347820 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-359c9767-968a-4637-8004-648c90f4f9f4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:24.348350 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-359c9767-968a-4637-8004-648c90f4f9f4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:24.348800 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-359c9767-968a-4637-8004-648c90f4f9f4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:24.349548 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-359c9767-968a-4637-8004-648c90f4f9f4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:24.350033 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-359c9767-968a-4637-8004-648c90f4f9f4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:24.350464 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-359c9767-968a-4637-8004-648c90f4f9f4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:24.493478 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-359c9767-968a-4637-8004-648c90f4f9f4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:24.502221 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-359c9767-968a-4637-8004-648c90f4f9f4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1265 microversion: 2.1 time: 0.165605 Aug 30 01:20:24.502894 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 576/1109] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:24 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:25.523854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-17177c83-3051-431a-a658-f66368283d89 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:25.524565 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-17177c83-3051-431a-a658-f66368283d89 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:25.531649 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17177c83-3051-431a-a658-f66368283d89 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:25.532138 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17177c83-3051-431a-a658-f66368283d89 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:25.532578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17177c83-3051-431a-a658-f66368283d89 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:25.533282 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17177c83-3051-431a-a658-f66368283d89 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:25.533767 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17177c83-3051-431a-a658-f66368283d89 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:25.534204 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-17177c83-3051-431a-a658-f66368283d89 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:25.675015 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-17177c83-3051-431a-a658-f66368283d89 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:25.683373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-17177c83-3051-431a-a658-f66368283d89 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1265 microversion: 2.1 time: 0.164254 Aug 30 01:20:25.684093 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 534/1110] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:25 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:26.704310 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-54dac545-992a-4de7-9dc2-5a211c07562a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:26.704923 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-54dac545-992a-4de7-9dc2-5a211c07562a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:26.711646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54dac545-992a-4de7-9dc2-5a211c07562a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:26.712139 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54dac545-992a-4de7-9dc2-5a211c07562a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:26.712594 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54dac545-992a-4de7-9dc2-5a211c07562a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:26.713995 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54dac545-992a-4de7-9dc2-5a211c07562a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:26.714499 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54dac545-992a-4de7-9dc2-5a211c07562a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:26.714929 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-54dac545-992a-4de7-9dc2-5a211c07562a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:26.860586 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-54dac545-992a-4de7-9dc2-5a211c07562a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:26.868370 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-54dac545-992a-4de7-9dc2-5a211c07562a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1451 microversion: 2.1 time: 0.167904 Aug 30 01:20:26.868945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 577/1111] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:26 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:26.888998 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3eda4841-e01c-47ff-8702-c61067ed3bf4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:26.889641 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3eda4841-e01c-47ff-8702-c61067ed3bf4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:26.896109 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3eda4841-e01c-47ff-8702-c61067ed3bf4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:26.896599 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3eda4841-e01c-47ff-8702-c61067ed3bf4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:26.897043 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3eda4841-e01c-47ff-8702-c61067ed3bf4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:26.897752 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3eda4841-e01c-47ff-8702-c61067ed3bf4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:26.898221 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3eda4841-e01c-47ff-8702-c61067ed3bf4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:26.898655 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3eda4841-e01c-47ff-8702-c61067ed3bf4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:27.028999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3eda4841-e01c-47ff-8702-c61067ed3bf4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:27.037062 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3eda4841-e01c-47ff-8702-c61067ed3bf4 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1451 microversion: 2.1 time: 0.152416 Aug 30 01:20:27.037639 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 535/1112] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:26 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:20:29.362380 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-7201bbb7-c384-4b9e-85a3-7e18cecb46c7 req-0b4a6511-766c-4498-8632-2512f71f9518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9", "tag": "fd271197-9d24-4e46-858e-e54a62ef8533"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:29.373219 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-7201bbb7-c384-4b9e-85a3-7e18cecb46c7 req-0b4a6511-766c-4498-8632-2512f71f9518 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:29.373953 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-7201bbb7-c384-4b9e-85a3-7e18cecb46c7 req-0b4a6511-766c-4498-8632-2512f71f9518 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:29.374377 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-7201bbb7-c384-4b9e-85a3-7e18cecb46c7 req-0b4a6511-766c-4498-8632-2512f71f9518 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:29.387719 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-7201bbb7-c384-4b9e-85a3-7e18cecb46c7 req-0b4a6511-766c-4498-8632-2512f71f9518 service nova] Creating event network-changed:fd271197-9d24-4e46-858e-e54a62ef8533 for instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 on hv-cinder-81571 Aug 30 01:20:29.394671 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-7201bbb7-c384-4b9e-85a3-7e18cecb46c7 req-0b4a6511-766c-4498-8632-2512f71f9518 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035962 Aug 30 01:20:29.395319 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 578/1113] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:20:32.066450 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3e403f69-00a3-455d-87fb-c142efca97bd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d68a0d17-b417-4373-bfb6-e1f28aad6dda", "device": "/dev/sdb"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:20:32.069242 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3e403f69-00a3-455d-87fb-c142efca97bd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:32.071770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:32.076509 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e403f69-00a3-455d-87fb-c142efca97bd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:32.076986 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e403f69-00a3-455d-87fb-c142efca97bd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:32.077419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e403f69-00a3-455d-87fb-c142efca97bd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:32.078138 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e403f69-00a3-455d-87fb-c142efca97bd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:32.078590 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e403f69-00a3-455d-87fb-c142efca97bd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:32.079015 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e403f69-00a3-455d-87fb-c142efca97bd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:32.081499 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=93 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:32.761628 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3e403f69-00a3-455d-87fb-c142efca97bd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "POST /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.698871 Aug 30 01:20:32.762281 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 536/1114] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 30 01:20:32 2022] POST /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2/os-volume_attachments => generated 194 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:20:57.545295 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:57.546070 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=90 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:57.550281 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b7080fbd-9863-4d04-bc7b-2186c594d051 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:57.550870 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b7080fbd-9863-4d04-bc7b-2186c594d051 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:57.556848 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b7080fbd-9863-4d04-bc7b-2186c594d051 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:57.559795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b7080fbd-9863-4d04-bc7b-2186c594d051 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:57.559795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b7080fbd-9863-4d04-bc7b-2186c594d051 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:57.559795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b7080fbd-9863-4d04-bc7b-2186c594d051 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:57.559795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b7080fbd-9863-4d04-bc7b-2186c594d051 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:57.560351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b7080fbd-9863-4d04-bc7b-2186c594d051 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:57.769630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-b7080fbd-9863-4d04-bc7b-2186c594d051 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lazy-loading 'services' on Instance uuid efeb4c87-61e6-4f02-a63a-b08aa0f825b2 {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:20:57.995218 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-b7080fbd-9863-4d04-bc7b-2186c594d051 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "DELETE /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2/os-volume_attachments/d68a0d17-b417-4373-bfb6-e1f28aad6dda" status: 202 len: 0 microversion: 2.1 time: 0.451165 Aug 30 01:20:57.996338 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 579/1115] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 30 01:20:57 2022] DELETE /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2/os-volume_attachments/d68a0d17-b417-4373-bfb6-e1f28aad6dda => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:20:59.302302 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:59.303145 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:20:59.307166 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-99f78003-8638-4d62-b068-2f938fde51a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:59.307753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-99f78003-8638-4d62-b068-2f938fde51a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:59.314153 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99f78003-8638-4d62-b068-2f938fde51a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:59.314666 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99f78003-8638-4d62-b068-2f938fde51a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:59.315077 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99f78003-8638-4d62-b068-2f938fde51a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:59.315770 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99f78003-8638-4d62-b068-2f938fde51a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:59.316253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99f78003-8638-4d62-b068-2f938fde51a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:59.316680 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99f78003-8638-4d62-b068-2f938fde51a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:59.343214 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-99f78003-8638-4d62-b068-2f938fde51a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:20:59.693625 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-99f78003-8638-4d62-b068-2f938fde51a6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "DELETE /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 204 len: 0 microversion: 2.1 time: 0.392645 Aug 30 01:20:59.694261 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 537/1116] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:20:59 2022] DELETE /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:20:59.704203 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5fe7ec5d-9501-4fb0-8af2-ce6dd8bfca02 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:20:59.704905 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5fe7ec5d-9501-4fb0-8af2-ce6dd8bfca02 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:20:59.711157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fe7ec5d-9501-4fb0-8af2-ce6dd8bfca02 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:59.711636 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fe7ec5d-9501-4fb0-8af2-ce6dd8bfca02 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:59.712071 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fe7ec5d-9501-4fb0-8af2-ce6dd8bfca02 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:59.712756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fe7ec5d-9501-4fb0-8af2-ce6dd8bfca02 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:20:59.713209 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fe7ec5d-9501-4fb0-8af2-ce6dd8bfca02 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:20:59.713627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5fe7ec5d-9501-4fb0-8af2-ce6dd8bfca02 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:20:59.846273 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5fe7ec5d-9501-4fb0-8af2-ce6dd8bfca02 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:20:59.854110 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5fe7ec5d-9501-4fb0-8af2-ce6dd8bfca02 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 200 len: 1513 microversion: 2.1 time: 0.155314 Aug 30 01:20:59.855281 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 580/1117] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:20:59 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:00.877695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-432b9fbb-fd6a-4cad-b4f4-8c33a56eac4e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:00.878412 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-432b9fbb-fd6a-4cad-b4f4-8c33a56eac4e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:00.884762 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-432b9fbb-fd6a-4cad-b4f4-8c33a56eac4e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:00.885248 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-432b9fbb-fd6a-4cad-b4f4-8c33a56eac4e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:00.885680 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-432b9fbb-fd6a-4cad-b4f4-8c33a56eac4e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:00.886904 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-432b9fbb-fd6a-4cad-b4f4-8c33a56eac4e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:00.887354 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-432b9fbb-fd6a-4cad-b4f4-8c33a56eac4e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:00.887776 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-432b9fbb-fd6a-4cad-b4f4-8c33a56eac4e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:01.075938 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-432b9fbb-fd6a-4cad-b4f4-8c33a56eac4e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:01.083934 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-432b9fbb-fd6a-4cad-b4f4-8c33a56eac4e tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 200 len: 1513 microversion: 2.1 time: 0.211040 Aug 30 01:21:01.084501 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 538/1118] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:00 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 1513 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:02.104516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4382d74d-c49a-4c32-8c48-39f9cd3ad512 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:02.105841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4382d74d-c49a-4c32-8c48-39f9cd3ad512 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:02.112336 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4382d74d-c49a-4c32-8c48-39f9cd3ad512 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:02.116726 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4382d74d-c49a-4c32-8c48-39f9cd3ad512 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:02.116726 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4382d74d-c49a-4c32-8c48-39f9cd3ad512 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:02.116726 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4382d74d-c49a-4c32-8c48-39f9cd3ad512 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:02.116726 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4382d74d-c49a-4c32-8c48-39f9cd3ad512 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:02.117103 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4382d74d-c49a-4c32-8c48-39f9cd3ad512 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:02.252240 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4382d74d-c49a-4c32-8c48-39f9cd3ad512 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:02.260359 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4382d74d-c49a-4c32-8c48-39f9cd3ad512 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 200 len: 1513 microversion: 2.1 time: 0.159610 Aug 30 01:21:02.261687 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 581/1119] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:02 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:02.602660 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-445054a4-1ee6-40a5-8b80-76a5d1fd9365 req-9a24d6f2-6222-4a23-9b57-0618285c71b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efeb4c87-61e6-4f02-a63a-b08aa0f825b2", "name": "network-vif-deleted", "tag": "fa5bce71-7c73-45dd-98d6-e1ca6af10991"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:02.613789 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-445054a4-1ee6-40a5-8b80-76a5d1fd9365 req-9a24d6f2-6222-4a23-9b57-0618285c71b3 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:02.614272 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-445054a4-1ee6-40a5-8b80-76a5d1fd9365 req-9a24d6f2-6222-4a23-9b57-0618285c71b3 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:02.614710 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-445054a4-1ee6-40a5-8b80-76a5d1fd9365 req-9a24d6f2-6222-4a23-9b57-0618285c71b3 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:02.625862 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-445054a4-1ee6-40a5-8b80-76a5d1fd9365 req-9a24d6f2-6222-4a23-9b57-0618285c71b3 service nova] Creating event network-vif-deleted:fa5bce71-7c73-45dd-98d6-e1ca6af10991 for instance efeb4c87-61e6-4f02-a63a-b08aa0f825b2 on hv-cinder-81571 Aug 30 01:21:02.630831 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-445054a4-1ee6-40a5-8b80-76a5d1fd9365 req-9a24d6f2-6222-4a23-9b57-0618285c71b3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031898 Aug 30 01:21:02.631463 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 539/1120] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:21:03.282163 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ff06ad21-ea8b-4144-affe-0549cd81ec7d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:03.282768 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ff06ad21-ea8b-4144-affe-0549cd81ec7d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:03.289358 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ff06ad21-ea8b-4144-affe-0549cd81ec7d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:03.289875 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ff06ad21-ea8b-4144-affe-0549cd81ec7d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:03.290305 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ff06ad21-ea8b-4144-affe-0549cd81ec7d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:03.290982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ff06ad21-ea8b-4144-affe-0549cd81ec7d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:03.291452 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ff06ad21-ea8b-4144-affe-0549cd81ec7d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:03.291874 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ff06ad21-ea8b-4144-affe-0549cd81ec7d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:03.323433 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ff06ad21-ea8b-4144-affe-0549cd81ec7d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:03.323980 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ff06ad21-ea8b-4144-affe-0549cd81ec7d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:03.324413 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ff06ad21-ea8b-4144-affe-0549cd81ec7d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:03.324856 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-ff06ad21-ea8b-4144-affe-0549cd81ec7d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lazy-loading 'fault' on Instance uuid efeb4c87-61e6-4f02-a63a-b08aa0f825b2 {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:21:03.368710 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ff06ad21-ea8b-4144-affe-0549cd81ec7d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:03.376873 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ff06ad21-ea8b-4144-affe-0549cd81ec7d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 200 len: 1309 microversion: 2.1 time: 0.098537 Aug 30 01:21:03.377446 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 582/1121] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:03 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:04.399198 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f64cd89e-a22e-4827-9281-e04270aa6213 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:04.399891 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f64cd89e-a22e-4827-9281-e04270aa6213 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: efeb4c87-61e6-4f02-a63a-b08aa0f825b2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:04.406286 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f64cd89e-a22e-4827-9281-e04270aa6213 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:04.406764 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f64cd89e-a22e-4827-9281-e04270aa6213 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:04.407199 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f64cd89e-a22e-4827-9281-e04270aa6213 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:04.407885 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f64cd89e-a22e-4827-9281-e04270aa6213 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:04.408344 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f64cd89e-a22e-4827-9281-e04270aa6213 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:04.409036 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f64cd89e-a22e-4827-9281-e04270aa6213 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:04.423185 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-f64cd89e-a22e-4827-9281-e04270aa6213 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] HTTP exception thrown: Instance efeb4c87-61e6-4f02-a63a-b08aa0f825b2 could not be found. Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f64cd89e-a22e-4827-9281-e04270aa6213 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Request method failure captured: Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 HTTP/1.1 Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWW_iHHpPYZlHkuKssRpOlvcvTsXvSyyWhuasuJ1fBUwivyE9rCtdYJqo2OCFtkVdpZQVK1xaGSqRupQN-p4BJFYyWOHHXBVynIj3CRlNp8aEWVxkLGA5OKnZ5BrYrw162Y3iv0h6lnCyDe4s_fGz6korzpRHL-8fEthdIA7ZdyhalA Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 6bb93b63909346cbab03513b7707f7b8 Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1910596305 Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:21:04.424854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:21:04.426713 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bb93b63909346cbab03513b7707f7b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bb93b63909346cbab03513b7707f7b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bb93b63909346cbab03513b7707f7b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bb93b63909346cbab03513b7707f7b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:21:04.426713 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesSnapshotTestJSON-1910596305 Aug 30 01:21:04.426713 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 6bb93b63909346cbab03513b7707f7b8 Aug 30 01:21:04.426713 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1910596305 Aug 30 01:21:04.426713 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesSnapshotTestJSON-1910596305-project Aug 30 01:21:04.426713 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:21:04.426713 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:21:04.426713 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: 998bb52979154fdc824ec07589df82c6 Aug 30 01:21:04.426713 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesSnapshotTestJSON-1910596305-project Aug 30 01:21:04.426713 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:21:04.426713 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance efeb4c87-61e6-4f02-a63a-b08aa0f825b2 could not be found. Aug 30 01:21:04.426713 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': 'efeb4c87-61e6-4f02-a63a-b08aa0f825b2'} Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efeb4c87-61e6-4f02-a63a-b08aa0f825b2 could not be found. Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:21:04.427757 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efeb4c87-61e6-4f02-a63a-b08aa0f825b2 could not be found. Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efeb4c87-61e6-4f02-a63a-b08aa0f825b2 could not be found. Aug 30 01:21:04.429604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:21:04.431047 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f64cd89e-a22e-4827-9281-e04270aa6213 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Returning 404 to user: Instance efeb4c87-61e6-4f02-a63a-b08aa0f825b2 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:21:04.431047 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f64cd89e-a22e-4827-9281-e04270aa6213 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2" status: 404 len: 111 microversion: 2.1 time: 0.031826 Aug 30 01:21:04.431047 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 540/1122] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:04 2022] GET /compute/v2.1/servers/efeb4c87-61e6-4f02-a63a-b08aa0f825b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:21:14.893278 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-278618856", "imageRef": "bd1b3376-ea5f-4988-bdbb-531bafd01942", "flavorRef": "452", "networks": [{"uuid": "85f2aca7-11a7-421d-a0b1-55a0f1bf9d8c"}]}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:14.907253 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=10 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:14.909981 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:14.986587 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.network.neutron [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] validate_networks() for [('85f2aca7-11a7-421d-a0b1-55a0f1bf9d8c', None, None, None, None, None)] {{(pid=121233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:21:15.342230 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Flavor limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:21:15.342646 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Image limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:21:15.343111 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Flavor pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:21:15.343514 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Image pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:21:15.343945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:21:15.352750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:15.353161 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:15.353600 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:15.354501 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:15.354999 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:15.355418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:15.372076 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Getting quotas for project 6bb93b63909346cbab03513b7707f7b8. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:21:15.375937 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Getting quotas for user 998bb52979154fdc824ec07589df82c6 and project 6bb93b63909346cbab03513b7707f7b8. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:21:15.387292 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Going to run 1 instances... {{(pid=121233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:21:15.389595 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd1b3376-ea5f-4988-bdbb-531bafd01942',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:21:15.558637 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-b925e404-313f-4b99-8931-63951a71ae44 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670050 Aug 30 01:21:15.559421 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 583/1123] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:21:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 01:21:15.570343 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d46603a6-f57d-4d7f-89cb-2f9bc43c370b tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:15.571012 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d46603a6-f57d-4d7f-89cb-2f9bc43c370b tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:15.574070 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:15.574735 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:15.631091 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d46603a6-f57d-4d7f-89cb-2f9bc43c370b tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:15.638820 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d46603a6-f57d-4d7f-89cb-2f9bc43c370b tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1218 microversion: 2.1 time: 0.072245 Aug 30 01:21:15.639394 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 541/1124] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:15 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:16.659137 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0d24c26e-b088-45cc-b858-565e8a643840 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:16.659820 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0d24c26e-b088-45cc-b858-565e8a643840 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:16.668042 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0d24c26e-b088-45cc-b858-565e8a643840 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:16.668532 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0d24c26e-b088-45cc-b858-565e8a643840 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:16.668976 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0d24c26e-b088-45cc-b858-565e8a643840 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:16.669679 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0d24c26e-b088-45cc-b858-565e8a643840 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:16.670331 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0d24c26e-b088-45cc-b858-565e8a643840 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:16.670688 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0d24c26e-b088-45cc-b858-565e8a643840 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:16.733401 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-0d24c26e-b088-45cc-b858-565e8a643840 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:16.741403 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0d24c26e-b088-45cc-b858-565e8a643840 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1214 microversion: 2.1 time: 0.086593 Aug 30 01:21:16.742016 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 584/1125] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:16 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:16.815297 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-67526e85-11de-450e-864e-a6e3bdc3d3ef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:16.815897 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-67526e85-11de-450e-864e-a6e3bdc3d3ef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:16.824316 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-67526e85-11de-450e-864e-a6e3bdc3d3ef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:16.824805 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-67526e85-11de-450e-864e-a6e3bdc3d3ef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:16.825236 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-67526e85-11de-450e-864e-a6e3bdc3d3ef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:16.825957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-67526e85-11de-450e-864e-a6e3bdc3d3ef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:16.826411 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-67526e85-11de-450e-864e-a6e3bdc3d3ef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:16.833277 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-67526e85-11de-450e-864e-a6e3bdc3d3ef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:16.849535 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-67526e85-11de-450e-864e-a6e3bdc3d3ef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lazy-loading 'flavor' on Instance uuid e28fa016-241d-473f-9697-13ab6e06fa91 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:21:17.166544 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-67526e85-11de-450e-864e-a6e3bdc3d3ef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "POST /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91/action" status: 202 len: 0 microversion: 2.1 time: 0.355667 Aug 30 01:21:17.167744 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 542/1126] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 30 01:21:16 2022] POST /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:21:17.176240 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-89b116d7-d84f-44fd-ba2c-0edf3f09bc4e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:17.176899 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-89b116d7-d84f-44fd-ba2c-0edf3f09bc4e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:17.183154 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-89b116d7-d84f-44fd-ba2c-0edf3f09bc4e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:17.183695 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-89b116d7-d84f-44fd-ba2c-0edf3f09bc4e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:17.184147 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-89b116d7-d84f-44fd-ba2c-0edf3f09bc4e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:17.184839 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-89b116d7-d84f-44fd-ba2c-0edf3f09bc4e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:17.185290 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-89b116d7-d84f-44fd-ba2c-0edf3f09bc4e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:17.185716 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-89b116d7-d84f-44fd-ba2c-0edf3f09bc4e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:17.321615 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-89b116d7-d84f-44fd-ba2c-0edf3f09bc4e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:17.330035 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-89b116d7-d84f-44fd-ba2c-0edf3f09bc4e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1568 microversion: 2.1 time: 0.157718 Aug 30 01:21:17.330649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 585/1127] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:17 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:17.766089 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-abf23c37-1007-40b5-b04c-0133df959fb6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:17.766724 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-abf23c37-1007-40b5-b04c-0133df959fb6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:17.773675 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-abf23c37-1007-40b5-b04c-0133df959fb6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:17.774201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-abf23c37-1007-40b5-b04c-0133df959fb6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:17.774858 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-abf23c37-1007-40b5-b04c-0133df959fb6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:17.775577 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-abf23c37-1007-40b5-b04c-0133df959fb6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:17.776233 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-abf23c37-1007-40b5-b04c-0133df959fb6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:17.777095 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-abf23c37-1007-40b5-b04c-0133df959fb6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:17.873352 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-abf23c37-1007-40b5-b04c-0133df959fb6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:17.882219 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-abf23c37-1007-40b5-b04c-0133df959fb6 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1278 microversion: 2.1 time: 0.121812 Aug 30 01:21:17.882825 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 543/1128] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:17 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:18.352787 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ad1ed998-227b-4e9c-8551-bedd65d12baf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:18.353420 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ad1ed998-227b-4e9c-8551-bedd65d12baf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:18.360971 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ad1ed998-227b-4e9c-8551-bedd65d12baf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:18.361459 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ad1ed998-227b-4e9c-8551-bedd65d12baf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:18.361924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ad1ed998-227b-4e9c-8551-bedd65d12baf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:18.362712 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ad1ed998-227b-4e9c-8551-bedd65d12baf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:18.363168 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ad1ed998-227b-4e9c-8551-bedd65d12baf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:18.363594 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ad1ed998-227b-4e9c-8551-bedd65d12baf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:18.504907 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ad1ed998-227b-4e9c-8551-bedd65d12baf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:18.513207 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ad1ed998-227b-4e9c-8551-bedd65d12baf tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1568 microversion: 2.1 time: 0.164371 Aug 30 01:21:18.513856 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 586/1129] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:18 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:18.905074 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dee7fb08-985c-4cc0-86eb-f5c7385d0afe tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:18.905854 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dee7fb08-985c-4cc0-86eb-f5c7385d0afe tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:18.912749 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dee7fb08-985c-4cc0-86eb-f5c7385d0afe tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:18.913244 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dee7fb08-985c-4cc0-86eb-f5c7385d0afe tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:18.913690 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dee7fb08-985c-4cc0-86eb-f5c7385d0afe tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:18.914463 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dee7fb08-985c-4cc0-86eb-f5c7385d0afe tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:18.915075 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dee7fb08-985c-4cc0-86eb-f5c7385d0afe tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:18.915521 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dee7fb08-985c-4cc0-86eb-f5c7385d0afe tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:19.120138 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dee7fb08-985c-4cc0-86eb-f5c7385d0afe tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:19.129287 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dee7fb08-985c-4cc0-86eb-f5c7385d0afe tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1318 microversion: 2.1 time: 0.229049 Aug 30 01:21:19.136503 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 544/1130] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:18 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:19.535387 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-1a747239-9def-4a52-a566-a115f49508db tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:19.536000 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-1a747239-9def-4a52-a566-a115f49508db tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:19.542898 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1a747239-9def-4a52-a566-a115f49508db tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:19.543467 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1a747239-9def-4a52-a566-a115f49508db tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:19.543909 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1a747239-9def-4a52-a566-a115f49508db tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:19.544639 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1a747239-9def-4a52-a566-a115f49508db tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:19.545076 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1a747239-9def-4a52-a566-a115f49508db tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:19.545521 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1a747239-9def-4a52-a566-a115f49508db tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:19.678671 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-1a747239-9def-4a52-a566-a115f49508db tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:19.687238 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-1a747239-9def-4a52-a566-a115f49508db tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1568 microversion: 2.1 time: 0.156006 Aug 30 01:21:19.687829 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 587/1131] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:19 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:19.705380 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-15f7a41c-99d9-4917-b866-c9e0a41002d3 req-de6ee2af-bc93-4fcf-874a-5202e4e7d9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c083502b-4d9b-42b8-828c-55e3009467ea", "tag": "cf35a532-38e2-4463-bdd1-18a2d56537e0"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:19.715578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-15f7a41c-99d9-4917-b866-c9e0a41002d3 req-de6ee2af-bc93-4fcf-874a-5202e4e7d9f8 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:19.716050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-15f7a41c-99d9-4917-b866-c9e0a41002d3 req-de6ee2af-bc93-4fcf-874a-5202e4e7d9f8 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:19.716475 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-15f7a41c-99d9-4917-b866-c9e0a41002d3 req-de6ee2af-bc93-4fcf-874a-5202e4e7d9f8 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:19.729767 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-15f7a41c-99d9-4917-b866-c9e0a41002d3 req-de6ee2af-bc93-4fcf-874a-5202e4e7d9f8 service nova] Creating event network-changed:cf35a532-38e2-4463-bdd1-18a2d56537e0 for instance c083502b-4d9b-42b8-828c-55e3009467ea on hv-cinder-81571 Aug 30 01:21:19.734641 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-15f7a41c-99d9-4917-b866-c9e0a41002d3 req-de6ee2af-bc93-4fcf-874a-5202e4e7d9f8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033944 Aug 30 01:21:19.735239 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 545/1132] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:21:20.150763 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-47f3ed6c-f4be-41ef-ac6b-f688aba34164 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:20.150962 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-47f3ed6c-f4be-41ef-ac6b-f688aba34164 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:20.156885 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-47f3ed6c-f4be-41ef-ac6b-f688aba34164 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:20.157367 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-47f3ed6c-f4be-41ef-ac6b-f688aba34164 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:20.157859 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-47f3ed6c-f4be-41ef-ac6b-f688aba34164 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:20.158962 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-47f3ed6c-f4be-41ef-ac6b-f688aba34164 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:20.161754 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-47f3ed6c-f4be-41ef-ac6b-f688aba34164 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:20.162271 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-47f3ed6c-f4be-41ef-ac6b-f688aba34164 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:20.308777 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-47f3ed6c-f4be-41ef-ac6b-f688aba34164 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:20.317086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-47f3ed6c-f4be-41ef-ac6b-f688aba34164 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1318 microversion: 2.1 time: 0.170628 Aug 30 01:21:20.322951 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 588/1133] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:20 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:20.710197 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-194eb99d-2914-4147-85c1-0f30b216ef71 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:20.710906 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-194eb99d-2914-4147-85c1-0f30b216ef71 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:20.717857 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-194eb99d-2914-4147-85c1-0f30b216ef71 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:20.718340 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-194eb99d-2914-4147-85c1-0f30b216ef71 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:20.718781 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-194eb99d-2914-4147-85c1-0f30b216ef71 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:20.719481 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-194eb99d-2914-4147-85c1-0f30b216ef71 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:20.719940 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-194eb99d-2914-4147-85c1-0f30b216ef71 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:20.720369 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-194eb99d-2914-4147-85c1-0f30b216ef71 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:20.856337 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-194eb99d-2914-4147-85c1-0f30b216ef71 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:20.864051 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-194eb99d-2914-4147-85c1-0f30b216ef71 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1568 microversion: 2.1 time: 0.158620 Aug 30 01:21:20.864631 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 546/1134] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:20 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:21:21.342430 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6a6db903-b1ca-4912-afc2-64d72fe7fc79 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:21.343035 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6a6db903-b1ca-4912-afc2-64d72fe7fc79 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:21.349089 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a6db903-b1ca-4912-afc2-64d72fe7fc79 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:21.349566 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a6db903-b1ca-4912-afc2-64d72fe7fc79 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:21.350037 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a6db903-b1ca-4912-afc2-64d72fe7fc79 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:21.350725 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a6db903-b1ca-4912-afc2-64d72fe7fc79 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:21.351175 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a6db903-b1ca-4912-afc2-64d72fe7fc79 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:21.351596 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a6db903-b1ca-4912-afc2-64d72fe7fc79 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:21.481466 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6a6db903-b1ca-4912-afc2-64d72fe7fc79 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:21.489353 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6a6db903-b1ca-4912-afc2-64d72fe7fc79 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1318 microversion: 2.1 time: 0.151242 Aug 30 01:21:21.489960 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 589/1135] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:21 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:21.885226 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-74129cdd-2eec-450b-857e-6380fb96ecec tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:21.886031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-74129cdd-2eec-450b-857e-6380fb96ecec tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:21.893992 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74129cdd-2eec-450b-857e-6380fb96ecec tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:21.894476 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74129cdd-2eec-450b-857e-6380fb96ecec tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:21.894902 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74129cdd-2eec-450b-857e-6380fb96ecec tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:21.895595 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74129cdd-2eec-450b-857e-6380fb96ecec tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:21.896038 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74129cdd-2eec-450b-857e-6380fb96ecec tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:21.896457 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-74129cdd-2eec-450b-857e-6380fb96ecec tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:22.031036 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-74129cdd-2eec-450b-857e-6380fb96ecec tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:22.039082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-74129cdd-2eec-450b-857e-6380fb96ecec tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1568 microversion: 2.1 time: 0.157774 Aug 30 01:21:22.039657 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 547/1136] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:21 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:22.512018 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-8febbece-0654-4099-8be6-20ba69da295b tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:22.512571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-8febbece-0654-4099-8be6-20ba69da295b tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:22.519181 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8febbece-0654-4099-8be6-20ba69da295b tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:22.519662 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8febbece-0654-4099-8be6-20ba69da295b tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:22.520106 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8febbece-0654-4099-8be6-20ba69da295b tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:22.520796 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8febbece-0654-4099-8be6-20ba69da295b tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:22.521253 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8febbece-0654-4099-8be6-20ba69da295b tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:22.521680 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8febbece-0654-4099-8be6-20ba69da295b tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:22.650448 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-8febbece-0654-4099-8be6-20ba69da295b tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:22.659078 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-8febbece-0654-4099-8be6-20ba69da295b tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1318 microversion: 2.1 time: 0.151592 Aug 30 01:21:22.659640 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 590/1137] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:22 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:23.061522 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-987c29e1-0371-4c57-aaf5-b40996a5354c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:23.062148 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-987c29e1-0371-4c57-aaf5-b40996a5354c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:23.068840 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-987c29e1-0371-4c57-aaf5-b40996a5354c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:23.069328 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-987c29e1-0371-4c57-aaf5-b40996a5354c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:23.069798 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-987c29e1-0371-4c57-aaf5-b40996a5354c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:23.070503 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-987c29e1-0371-4c57-aaf5-b40996a5354c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:23.070966 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-987c29e1-0371-4c57-aaf5-b40996a5354c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:23.071401 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-987c29e1-0371-4c57-aaf5-b40996a5354c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:23.206630 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-987c29e1-0371-4c57-aaf5-b40996a5354c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:23.214552 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-987c29e1-0371-4c57-aaf5-b40996a5354c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1568 microversion: 2.1 time: 0.157758 Aug 30 01:21:23.215130 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 548/1138] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:23 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:23.679821 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-8e67331c-5547-40fa-bf7e-be5d91124e99 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:23.680440 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-8e67331c-5547-40fa-bf7e-be5d91124e99 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:23.687010 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8e67331c-5547-40fa-bf7e-be5d91124e99 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:23.687494 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8e67331c-5547-40fa-bf7e-be5d91124e99 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:23.687934 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8e67331c-5547-40fa-bf7e-be5d91124e99 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:23.688630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8e67331c-5547-40fa-bf7e-be5d91124e99 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:23.689086 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8e67331c-5547-40fa-bf7e-be5d91124e99 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:23.689547 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8e67331c-5547-40fa-bf7e-be5d91124e99 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:23.823837 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-8e67331c-5547-40fa-bf7e-be5d91124e99 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:23.831750 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-8e67331c-5547-40fa-bf7e-be5d91124e99 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1318 microversion: 2.1 time: 0.155872 Aug 30 01:21:23.832327 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 591/1139] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:23 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:24.236242 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dd78dfed-82dd-45d1-9f94-6a2b717d27fc tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:24.236860 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dd78dfed-82dd-45d1-9f94-6a2b717d27fc tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:24.243556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd78dfed-82dd-45d1-9f94-6a2b717d27fc tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:24.244056 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd78dfed-82dd-45d1-9f94-6a2b717d27fc tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:24.244545 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd78dfed-82dd-45d1-9f94-6a2b717d27fc tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:24.245930 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd78dfed-82dd-45d1-9f94-6a2b717d27fc tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:24.246392 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd78dfed-82dd-45d1-9f94-6a2b717d27fc tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:24.246824 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd78dfed-82dd-45d1-9f94-6a2b717d27fc tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:24.380115 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dd78dfed-82dd-45d1-9f94-6a2b717d27fc tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:24.386687 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dd78dfed-82dd-45d1-9f94-6a2b717d27fc tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1568 microversion: 2.1 time: 0.154326 Aug 30 01:21:24.387266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 549/1140] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:24 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:24.853766 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-23be28c0-aba8-4a89-a098-864018f9f117 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:24.854438 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-23be28c0-aba8-4a89-a098-864018f9f117 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:24.861099 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-23be28c0-aba8-4a89-a098-864018f9f117 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:24.861578 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-23be28c0-aba8-4a89-a098-864018f9f117 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:24.862045 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-23be28c0-aba8-4a89-a098-864018f9f117 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:24.862776 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-23be28c0-aba8-4a89-a098-864018f9f117 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:24.863228 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-23be28c0-aba8-4a89-a098-864018f9f117 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:24.863657 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-23be28c0-aba8-4a89-a098-864018f9f117 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:24.996423 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-23be28c0-aba8-4a89-a098-864018f9f117 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:25.004118 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-23be28c0-aba8-4a89-a098-864018f9f117 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1318 microversion: 2.1 time: 0.154219 Aug 30 01:21:25.004688 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 592/1141] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:24 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:25.408146 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-46d19142-6ced-4298-ad57-800f5e991879 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:25.408777 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-46d19142-6ced-4298-ad57-800f5e991879 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:25.415352 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46d19142-6ced-4298-ad57-800f5e991879 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:25.415837 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46d19142-6ced-4298-ad57-800f5e991879 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:25.416279 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46d19142-6ced-4298-ad57-800f5e991879 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:25.417596 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46d19142-6ced-4298-ad57-800f5e991879 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:25.418093 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46d19142-6ced-4298-ad57-800f5e991879 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:25.418524 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46d19142-6ced-4298-ad57-800f5e991879 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:25.549443 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-46d19142-6ced-4298-ad57-800f5e991879 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:25.557842 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-46d19142-6ced-4298-ad57-800f5e991879 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1568 microversion: 2.1 time: 0.153307 Aug 30 01:21:25.558420 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 550/1142] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:25 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:26.024638 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-925f53d8-2986-4dac-a6cc-64ae2225da1d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:26.025264 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-925f53d8-2986-4dac-a6cc-64ae2225da1d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:26.027993 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=2 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:26.028728 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=6 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:26.034319 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-925f53d8-2986-4dac-a6cc-64ae2225da1d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:26.034915 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-925f53d8-2986-4dac-a6cc-64ae2225da1d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:26.035356 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-925f53d8-2986-4dac-a6cc-64ae2225da1d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:26.036058 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-925f53d8-2986-4dac-a6cc-64ae2225da1d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:26.036512 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-925f53d8-2986-4dac-a6cc-64ae2225da1d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:26.036940 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-925f53d8-2986-4dac-a6cc-64ae2225da1d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:26.173904 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-925f53d8-2986-4dac-a6cc-64ae2225da1d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:26.179707 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-c45d2aeb-fbe1-4cf3-b1f2-72193f6f8580 req-eb0b3d81-b633-4db1-bbec-6082685e146d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c083502b-4d9b-42b8-828c-55e3009467ea", "name": "network-vif-plugged", "status": "completed", "tag": "cf35a532-38e2-4463-bdd1-18a2d56537e0"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:26.181986 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-925f53d8-2986-4dac-a6cc-64ae2225da1d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1318 microversion: 2.1 time: 0.161182 Aug 30 01:21:26.182582 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 593/1143] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:26 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:26.196766 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:26.196766 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c45d2aeb-fbe1-4cf3-b1f2-72193f6f8580 req-eb0b3d81-b633-4db1-bbec-6082685e146d service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:26.196766 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c45d2aeb-fbe1-4cf3-b1f2-72193f6f8580 req-eb0b3d81-b633-4db1-bbec-6082685e146d service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:26.196766 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c45d2aeb-fbe1-4cf3-b1f2-72193f6f8580 req-eb0b3d81-b633-4db1-bbec-6082685e146d service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:26.202934 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-c45d2aeb-fbe1-4cf3-b1f2-72193f6f8580 req-eb0b3d81-b633-4db1-bbec-6082685e146d service nova] Creating event network-vif-plugged:cf35a532-38e2-4463-bdd1-18a2d56537e0 for instance c083502b-4d9b-42b8-828c-55e3009467ea on hv-cinder-81571 Aug 30 01:21:26.208108 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-c45d2aeb-fbe1-4cf3-b1f2-72193f6f8580 req-eb0b3d81-b633-4db1-bbec-6082685e146d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032330 Aug 30 01:21:26.208699 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 551/1144] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:21:26.579832 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e8dcfe21-3af4-4db9-ab16-dd3c6f93b5e4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:26.580442 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e8dcfe21-3af4-4db9-ab16-dd3c6f93b5e4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:26.586639 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8dcfe21-3af4-4db9-ab16-dd3c6f93b5e4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:26.587131 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8dcfe21-3af4-4db9-ab16-dd3c6f93b5e4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:26.587584 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8dcfe21-3af4-4db9-ab16-dd3c6f93b5e4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:26.588464 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8dcfe21-3af4-4db9-ab16-dd3c6f93b5e4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:26.589001 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8dcfe21-3af4-4db9-ab16-dd3c6f93b5e4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:26.589426 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e8dcfe21-3af4-4db9-ab16-dd3c6f93b5e4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:26.722594 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e8dcfe21-3af4-4db9-ab16-dd3c6f93b5e4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:26.731737 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e8dcfe21-3af4-4db9-ab16-dd3c6f93b5e4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1568 microversion: 2.1 time: 0.155799 Aug 30 01:21:26.732329 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 594/1145] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:26 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:27.204265 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-58b94af9-0261-4252-a32f-3d505eb2abef tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:27.205001 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-58b94af9-0261-4252-a32f-3d505eb2abef tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:27.211506 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58b94af9-0261-4252-a32f-3d505eb2abef tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:27.211980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58b94af9-0261-4252-a32f-3d505eb2abef tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:27.212422 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58b94af9-0261-4252-a32f-3d505eb2abef tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:27.213111 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58b94af9-0261-4252-a32f-3d505eb2abef tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:27.214361 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58b94af9-0261-4252-a32f-3d505eb2abef tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:27.214893 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-58b94af9-0261-4252-a32f-3d505eb2abef tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:27.345391 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-58b94af9-0261-4252-a32f-3d505eb2abef tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:27.353072 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-58b94af9-0261-4252-a32f-3d505eb2abef tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1318 microversion: 2.1 time: 0.153487 Aug 30 01:21:27.353646 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 552/1146] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:27 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:21:27.753681 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-91f87bbd-7016-4ab0-8c59-c15be811edef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:27.754351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-91f87bbd-7016-4ab0-8c59-c15be811edef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:27.761084 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91f87bbd-7016-4ab0-8c59-c15be811edef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:27.761565 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91f87bbd-7016-4ab0-8c59-c15be811edef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:27.762032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91f87bbd-7016-4ab0-8c59-c15be811edef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:27.762727 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91f87bbd-7016-4ab0-8c59-c15be811edef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:27.763207 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91f87bbd-7016-4ab0-8c59-c15be811edef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:27.763628 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-91f87bbd-7016-4ab0-8c59-c15be811edef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:27.895267 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-91f87bbd-7016-4ab0-8c59-c15be811edef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:27.904085 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-91f87bbd-7016-4ab0-8c59-c15be811edef tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1568 microversion: 2.1 time: 0.153811 Aug 30 01:21:27.904676 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 595/1147] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:27 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:28.373487 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b7d1ed50-b9b8-4f57-bec9-6b8de3f98507 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:28.374127 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b7d1ed50-b9b8-4f57-bec9-6b8de3f98507 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:28.380504 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7d1ed50-b9b8-4f57-bec9-6b8de3f98507 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:28.380981 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7d1ed50-b9b8-4f57-bec9-6b8de3f98507 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:28.381417 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7d1ed50-b9b8-4f57-bec9-6b8de3f98507 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:28.382129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7d1ed50-b9b8-4f57-bec9-6b8de3f98507 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:28.382586 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7d1ed50-b9b8-4f57-bec9-6b8de3f98507 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:28.383007 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b7d1ed50-b9b8-4f57-bec9-6b8de3f98507 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:28.597634 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b7d1ed50-b9b8-4f57-bec9-6b8de3f98507 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:28.605550 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b7d1ed50-b9b8-4f57-bec9-6b8de3f98507 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1506 microversion: 2.1 time: 0.236128 Aug 30 01:21:28.606151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 553/1148] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:28 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:28.626502 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-827ff475-c5a5-4d8a-bee1-3be6a8e0866a tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b71840c6-72cb-44bb-a078-be8fe8028f38", "device": "/dev/sdb"}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:28.631617 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-827ff475-c5a5-4d8a-bee1-3be6a8e0866a tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:28.636171 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-827ff475-c5a5-4d8a-bee1-3be6a8e0866a tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:28.636696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-827ff475-c5a5-4d8a-bee1-3be6a8e0866a tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:28.637136 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-827ff475-c5a5-4d8a-bee1-3be6a8e0866a tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:28.637868 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-827ff475-c5a5-4d8a-bee1-3be6a8e0866a tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:28.638327 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-827ff475-c5a5-4d8a-bee1-3be6a8e0866a tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:28.638756 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-827ff475-c5a5-4d8a-bee1-3be6a8e0866a tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:28.927036 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0f648bd3-64c9-4e85-afb0-340e364bd240 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:28.927661 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0f648bd3-64c9-4e85-afb0-340e364bd240 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:28.934414 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0f648bd3-64c9-4e85-afb0-340e364bd240 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:28.934939 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0f648bd3-64c9-4e85-afb0-340e364bd240 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:28.935387 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0f648bd3-64c9-4e85-afb0-340e364bd240 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:28.936303 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0f648bd3-64c9-4e85-afb0-340e364bd240 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:28.936771 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0f648bd3-64c9-4e85-afb0-340e364bd240 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:28.937231 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0f648bd3-64c9-4e85-afb0-340e364bd240 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:29.101587 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0f648bd3-64c9-4e85-afb0-340e364bd240 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:29.114963 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0f648bd3-64c9-4e85-afb0-340e364bd240 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1568 microversion: 2.1 time: 0.191470 Aug 30 01:21:29.116239 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 554/1149] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:28 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:21:29.560708 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-827ff475-c5a5-4d8a-bee1-3be6a8e0866a tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "POST /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.938011 Aug 30 01:21:29.561328 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 596/1150] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 30 01:21:28 2022] POST /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea/os-volume_attachments => generated 194 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:21:30.144016 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b2da7d6a-8d07-4d8c-a9bf-b56429389897 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:30.144616 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b2da7d6a-8d07-4d8c-a9bf-b56429389897 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:30.151143 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2da7d6a-8d07-4d8c-a9bf-b56429389897 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:30.151658 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2da7d6a-8d07-4d8c-a9bf-b56429389897 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:30.152101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2da7d6a-8d07-4d8c-a9bf-b56429389897 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:30.152797 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2da7d6a-8d07-4d8c-a9bf-b56429389897 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:30.153258 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2da7d6a-8d07-4d8c-a9bf-b56429389897 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:30.153691 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2da7d6a-8d07-4d8c-a9bf-b56429389897 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:30.289951 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b2da7d6a-8d07-4d8c-a9bf-b56429389897 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:30.298071 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b2da7d6a-8d07-4d8c-a9bf-b56429389897 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1568 microversion: 2.1 time: 0.157914 Aug 30 01:21:30.298652 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 555/1151] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:30 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:31.320406 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-dcbaed90-a467-417a-be8f-a27e0e1d5cf4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:31.321201 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-dcbaed90-a467-417a-be8f-a27e0e1d5cf4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:31.328412 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dcbaed90-a467-417a-be8f-a27e0e1d5cf4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:31.328907 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dcbaed90-a467-417a-be8f-a27e0e1d5cf4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:31.329345 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dcbaed90-a467-417a-be8f-a27e0e1d5cf4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:31.330080 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dcbaed90-a467-417a-be8f-a27e0e1d5cf4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:31.330542 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dcbaed90-a467-417a-be8f-a27e0e1d5cf4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:31.330968 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dcbaed90-a467-417a-be8f-a27e0e1d5cf4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:31.470827 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-dcbaed90-a467-417a-be8f-a27e0e1d5cf4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:31.478926 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-dcbaed90-a467-417a-be8f-a27e0e1d5cf4 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1568 microversion: 2.1 time: 0.162845 Aug 30 01:21:31.479527 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 597/1152] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:31 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:32.500922 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c36b9d01-3ad9-4f7e-9754-a6f1d9573d11 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:32.501571 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c36b9d01-3ad9-4f7e-9754-a6f1d9573d11 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:32.508299 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c36b9d01-3ad9-4f7e-9754-a6f1d9573d11 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:32.508784 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c36b9d01-3ad9-4f7e-9754-a6f1d9573d11 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:32.509220 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c36b9d01-3ad9-4f7e-9754-a6f1d9573d11 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:32.509967 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c36b9d01-3ad9-4f7e-9754-a6f1d9573d11 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:32.510494 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c36b9d01-3ad9-4f7e-9754-a6f1d9573d11 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:32.510915 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c36b9d01-3ad9-4f7e-9754-a6f1d9573d11 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:32.647547 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c36b9d01-3ad9-4f7e-9754-a6f1d9573d11 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:32.656403 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c36b9d01-3ad9-4f7e-9754-a6f1d9573d11 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1569 microversion: 2.1 time: 0.159306 Aug 30 01:21:32.656971 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 556/1153] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:32 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:32.677243 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6a8cb87d-8391-4339-87af-b2b1c244c804 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:32.677905 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6a8cb87d-8391-4339-87af-b2b1c244c804 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:32.684560 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a8cb87d-8391-4339-87af-b2b1c244c804 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:32.685073 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a8cb87d-8391-4339-87af-b2b1c244c804 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:32.685517 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a8cb87d-8391-4339-87af-b2b1c244c804 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:32.686237 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a8cb87d-8391-4339-87af-b2b1c244c804 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:32.686691 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a8cb87d-8391-4339-87af-b2b1c244c804 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:32.687118 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6a8cb87d-8391-4339-87af-b2b1c244c804 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:32.725218 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6a8cb87d-8391-4339-87af-b2b1c244c804 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121233) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 01:21:32.823902 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:33.060442 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6a8cb87d-8391-4339-87af-b2b1c244c804 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "POST /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91/action" status: 202 len: 0 microversion: 2.1 time: 0.387040 Aug 30 01:21:33.061089 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 598/1154] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 30 01:21:32 2022] POST /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:21:33.069799 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9d257e9e-b85b-4801-9887-465816776b1b tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:33.070708 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9d257e9e-b85b-4801-9887-465816776b1b tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:33.077349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9d257e9e-b85b-4801-9887-465816776b1b tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:33.077971 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9d257e9e-b85b-4801-9887-465816776b1b tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:33.078482 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9d257e9e-b85b-4801-9887-465816776b1b tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:33.079204 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9d257e9e-b85b-4801-9887-465816776b1b tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:33.079699 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9d257e9e-b85b-4801-9887-465816776b1b tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:33.080130 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9d257e9e-b85b-4801-9887-465816776b1b tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:33.221646 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9d257e9e-b85b-4801-9887-465816776b1b tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:33.225285 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:33.230419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9d257e9e-b85b-4801-9887-465816776b1b tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1517 microversion: 2.1 time: 0.164573 Aug 30 01:21:33.231002 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 557/1155] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:33 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:34.067380 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-409615c0-0583-4cb9-b544-d2fe508e6950 req-7e492669-4cb4-4fd7-a55a-46ef13300f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e28fa016-241d-473f-9697-13ab6e06fa91", "name": "network-vif-unplugged", "status": "completed", "tag": "c4e6504b-45ee-4446-8a10-2c25ab5d86a4"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:34.077749 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-409615c0-0583-4cb9-b544-d2fe508e6950 req-7e492669-4cb4-4fd7-a55a-46ef13300f04 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:34.078250 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-409615c0-0583-4cb9-b544-d2fe508e6950 req-7e492669-4cb4-4fd7-a55a-46ef13300f04 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:34.078681 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-409615c0-0583-4cb9-b544-d2fe508e6950 req-7e492669-4cb4-4fd7-a55a-46ef13300f04 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:34.093047 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.compute.server_external_events [req-409615c0-0583-4cb9-b544-d2fe508e6950 req-7e492669-4cb4-4fd7-a55a-46ef13300f04 service nova] Unable to find a host for instance e28fa016-241d-473f-9697-13ab6e06fa91. Dropping event network-vif-unplugged {{(pid=121233) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 01:21:34.093955 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-409615c0-0583-4cb9-b544-d2fe508e6950 req-7e492669-4cb4-4fd7-a55a-46ef13300f04 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031267 Aug 30 01:21:34.094548 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 599/1156] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 01:21:34.252477 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9e5c1d42-67fd-47a2-abb0-aeefa9496629 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:34.253101 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9e5c1d42-67fd-47a2-abb0-aeefa9496629 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:34.260287 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9e5c1d42-67fd-47a2-abb0-aeefa9496629 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:34.260782 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9e5c1d42-67fd-47a2-abb0-aeefa9496629 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:34.261228 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9e5c1d42-67fd-47a2-abb0-aeefa9496629 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:34.261965 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9e5c1d42-67fd-47a2-abb0-aeefa9496629 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:34.262457 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9e5c1d42-67fd-47a2-abb0-aeefa9496629 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:34.262891 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9e5c1d42-67fd-47a2-abb0-aeefa9496629 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:34.396004 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9e5c1d42-67fd-47a2-abb0-aeefa9496629 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:34.404548 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9e5c1d42-67fd-47a2-abb0-aeefa9496629 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1519 microversion: 2.1 time: 0.155939 Aug 30 01:21:34.405131 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 558/1157] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:34 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:35.428591 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d26f1cd6-5567-4cb3-ad47-ad247f192159 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:35.431015 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d26f1cd6-5567-4cb3-ad47-ad247f192159 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:35.436524 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d26f1cd6-5567-4cb3-ad47-ad247f192159 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:35.437009 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d26f1cd6-5567-4cb3-ad47-ad247f192159 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:35.437450 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d26f1cd6-5567-4cb3-ad47-ad247f192159 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:35.438170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d26f1cd6-5567-4cb3-ad47-ad247f192159 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:35.438736 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d26f1cd6-5567-4cb3-ad47-ad247f192159 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:35.439170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d26f1cd6-5567-4cb3-ad47-ad247f192159 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:35.569560 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d26f1cd6-5567-4cb3-ad47-ad247f192159 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:35.578038 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d26f1cd6-5567-4cb3-ad47-ad247f192159 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1519 microversion: 2.1 time: 0.153276 Aug 30 01:21:35.578605 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 600/1158] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:35 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:36.599537 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8f9bac82-711c-4b81-aafc-bbb9f2d1934d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:36.600059 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8f9bac82-711c-4b81-aafc-bbb9f2d1934d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:36.606675 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f9bac82-711c-4b81-aafc-bbb9f2d1934d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:36.607165 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f9bac82-711c-4b81-aafc-bbb9f2d1934d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:36.607623 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f9bac82-711c-4b81-aafc-bbb9f2d1934d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:36.608306 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f9bac82-711c-4b81-aafc-bbb9f2d1934d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:36.608753 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f9bac82-711c-4b81-aafc-bbb9f2d1934d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:36.609171 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8f9bac82-711c-4b81-aafc-bbb9f2d1934d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:36.754213 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8f9bac82-711c-4b81-aafc-bbb9f2d1934d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:36.762105 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8f9bac82-711c-4b81-aafc-bbb9f2d1934d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1519 microversion: 2.1 time: 0.166478 Aug 30 01:21:36.763188 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 559/1159] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:36 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:37.784254 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-87bf1e08-8d08-4294-8f8f-599e4a35df5e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:37.784793 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-87bf1e08-8d08-4294-8f8f-599e4a35df5e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:37.791808 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87bf1e08-8d08-4294-8f8f-599e4a35df5e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:37.792302 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87bf1e08-8d08-4294-8f8f-599e4a35df5e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:37.792785 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87bf1e08-8d08-4294-8f8f-599e4a35df5e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:37.793480 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87bf1e08-8d08-4294-8f8f-599e4a35df5e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:37.794049 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87bf1e08-8d08-4294-8f8f-599e4a35df5e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:37.794482 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-87bf1e08-8d08-4294-8f8f-599e4a35df5e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:37.928035 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-87bf1e08-8d08-4294-8f8f-599e4a35df5e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:37.936967 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-87bf1e08-8d08-4294-8f8f-599e4a35df5e tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1519 microversion: 2.1 time: 0.156973 Aug 30 01:21:37.937550 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 601/1160] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:37 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:38.959415 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e06be8f9-889a-4541-b2ee-fac13bcdac61 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:38.960459 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e06be8f9-889a-4541-b2ee-fac13bcdac61 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:38.968116 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e06be8f9-889a-4541-b2ee-fac13bcdac61 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:38.968613 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e06be8f9-889a-4541-b2ee-fac13bcdac61 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:38.969055 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e06be8f9-889a-4541-b2ee-fac13bcdac61 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:38.969794 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e06be8f9-889a-4541-b2ee-fac13bcdac61 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:38.970241 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e06be8f9-889a-4541-b2ee-fac13bcdac61 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:38.970723 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e06be8f9-889a-4541-b2ee-fac13bcdac61 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:39.104982 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e06be8f9-889a-4541-b2ee-fac13bcdac61 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:39.113526 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e06be8f9-889a-4541-b2ee-fac13bcdac61 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1519 microversion: 2.1 time: 0.158468 Aug 30 01:21:39.114396 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 560/1161] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:38 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:21:40.136088 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f05af6d2-8f26-418c-a0ca-cf73f78d0b2a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:40.136629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f05af6d2-8f26-418c-a0ca-cf73f78d0b2a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:40.143134 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f05af6d2-8f26-418c-a0ca-cf73f78d0b2a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:40.143616 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f05af6d2-8f26-418c-a0ca-cf73f78d0b2a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:40.144058 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f05af6d2-8f26-418c-a0ca-cf73f78d0b2a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:40.144739 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f05af6d2-8f26-418c-a0ca-cf73f78d0b2a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:40.145196 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f05af6d2-8f26-418c-a0ca-cf73f78d0b2a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:40.145636 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f05af6d2-8f26-418c-a0ca-cf73f78d0b2a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:40.277324 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f05af6d2-8f26-418c-a0ca-cf73f78d0b2a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:40.286315 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f05af6d2-8f26-418c-a0ca-cf73f78d0b2a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1575 microversion: 2.1 time: 0.154302 Aug 30 01:21:40.286895 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 602/1162] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:40 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:41.307865 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2b7f3ea3-d378-4398-9a40-166dd78ed27a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:41.308531 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2b7f3ea3-d378-4398-9a40-166dd78ed27a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:41.311822 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 01:21:41.311954 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Tue Aug 30 01:21:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 (ip 10.222.0.52) !!! Aug 30 01:21:41.319815 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b7f3ea3-d378-4398-9a40-166dd78ed27a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:41.320299 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b7f3ea3-d378-4398-9a40-166dd78ed27a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:41.320743 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b7f3ea3-d378-4398-9a40-166dd78ed27a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:41.321478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b7f3ea3-d378-4398-9a40-166dd78ed27a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:41.321967 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b7f3ea3-d378-4398-9a40-166dd78ed27a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:41.322399 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b7f3ea3-d378-4398-9a40-166dd78ed27a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:41.472648 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2b7f3ea3-d378-4398-9a40-166dd78ed27a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:41.484243 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2b7f3ea3-d378-4398-9a40-166dd78ed27a tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1575 microversion: 2.1 time: 0.179857 Aug 30 01:21:41.485424 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 561/1163] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:41 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:42.512768 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5c227b3c-a165-479b-9a71-c715dc387618 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:42.513417 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5c227b3c-a165-479b-9a71-c715dc387618 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:42.520552 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c227b3c-a165-479b-9a71-c715dc387618 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:42.521031 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c227b3c-a165-479b-9a71-c715dc387618 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:42.521470 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c227b3c-a165-479b-9a71-c715dc387618 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:42.522187 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c227b3c-a165-479b-9a71-c715dc387618 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:42.522641 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c227b3c-a165-479b-9a71-c715dc387618 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:42.523061 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c227b3c-a165-479b-9a71-c715dc387618 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:42.659159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5c227b3c-a165-479b-9a71-c715dc387618 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:42.667531 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5c227b3c-a165-479b-9a71-c715dc387618 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1575 microversion: 2.1 time: 0.158546 Aug 30 01:21:42.668098 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 603/1164] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:42 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:43.689052 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2969de7e-8ca2-45ca-b35d-e110114a7b25 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:43.689682 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2969de7e-8ca2-45ca-b35d-e110114a7b25 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:43.696416 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2969de7e-8ca2-45ca-b35d-e110114a7b25 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:43.697026 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2969de7e-8ca2-45ca-b35d-e110114a7b25 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:43.697341 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2969de7e-8ca2-45ca-b35d-e110114a7b25 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:43.698080 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2969de7e-8ca2-45ca-b35d-e110114a7b25 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:43.698542 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2969de7e-8ca2-45ca-b35d-e110114a7b25 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:43.698977 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2969de7e-8ca2-45ca-b35d-e110114a7b25 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:43.835350 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2969de7e-8ca2-45ca-b35d-e110114a7b25 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:43.843449 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2969de7e-8ca2-45ca-b35d-e110114a7b25 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1575 microversion: 2.1 time: 0.158735 Aug 30 01:21:43.844030 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 562/1165] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:43 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:44.867269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-dc80e463-ca5f-41f6-8697-40a3b0ae3cf0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:44.868375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-dc80e463-ca5f-41f6-8697-40a3b0ae3cf0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:44.876338 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dc80e463-ca5f-41f6-8697-40a3b0ae3cf0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:44.876869 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dc80e463-ca5f-41f6-8697-40a3b0ae3cf0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:44.877303 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dc80e463-ca5f-41f6-8697-40a3b0ae3cf0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:44.878024 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dc80e463-ca5f-41f6-8697-40a3b0ae3cf0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:44.878475 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dc80e463-ca5f-41f6-8697-40a3b0ae3cf0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:44.878897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-dc80e463-ca5f-41f6-8697-40a3b0ae3cf0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:45.053748 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-dc80e463-ca5f-41f6-8697-40a3b0ae3cf0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:45.065422 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-dc80e463-ca5f-41f6-8697-40a3b0ae3cf0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1575 microversion: 2.1 time: 0.204153 Aug 30 01:21:45.066368 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 604/1166] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:44 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1575 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:46.090373 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e120120e-d643-4177-ae04-a634ccc7541f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:46.090994 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e120120e-d643-4177-ae04-a634ccc7541f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:46.098144 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e120120e-d643-4177-ae04-a634ccc7541f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:46.098637 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e120120e-d643-4177-ae04-a634ccc7541f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:46.099081 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e120120e-d643-4177-ae04-a634ccc7541f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:46.099783 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e120120e-d643-4177-ae04-a634ccc7541f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:46.100244 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e120120e-d643-4177-ae04-a634ccc7541f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:46.100671 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e120120e-d643-4177-ae04-a634ccc7541f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:46.234095 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e120120e-d643-4177-ae04-a634ccc7541f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:46.242025 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e120120e-d643-4177-ae04-a634ccc7541f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1575 microversion: 2.1 time: 0.155542 Aug 30 01:21:46.242604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 563/1167] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:46 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:47.263902 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-6956ac4e-e7e4-4e12-8988-2fdb3d5462fa tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:47.264741 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-6956ac4e-e7e4-4e12-8988-2fdb3d5462fa tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:47.267113 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:47.271948 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6956ac4e-e7e4-4e12-8988-2fdb3d5462fa tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:47.272435 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6956ac4e-e7e4-4e12-8988-2fdb3d5462fa tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:47.272875 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6956ac4e-e7e4-4e12-8988-2fdb3d5462fa tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:47.273569 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6956ac4e-e7e4-4e12-8988-2fdb3d5462fa tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:47.274058 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6956ac4e-e7e4-4e12-8988-2fdb3d5462fa tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:47.274482 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-6956ac4e-e7e4-4e12-8988-2fdb3d5462fa tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:47.412691 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-6956ac4e-e7e4-4e12-8988-2fdb3d5462fa tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:47.421215 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-6956ac4e-e7e4-4e12-8988-2fdb3d5462fa tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1575 microversion: 2.1 time: 0.160701 Aug 30 01:21:47.421863 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 605/1168] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:47 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:48.446016 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-97fd3c7e-d468-426c-81da-4706b1aecf89 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:48.446575 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-97fd3c7e-d468-426c-81da-4706b1aecf89 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:48.448970 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=49 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:21:48.454947 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97fd3c7e-d468-426c-81da-4706b1aecf89 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:48.455404 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97fd3c7e-d468-426c-81da-4706b1aecf89 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:48.460264 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97fd3c7e-d468-426c-81da-4706b1aecf89 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:48.460264 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97fd3c7e-d468-426c-81da-4706b1aecf89 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:48.460264 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97fd3c7e-d468-426c-81da-4706b1aecf89 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:48.460264 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97fd3c7e-d468-426c-81da-4706b1aecf89 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:48.592741 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-97fd3c7e-d468-426c-81da-4706b1aecf89 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:48.600684 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-97fd3c7e-d468-426c-81da-4706b1aecf89 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1575 microversion: 2.1 time: 0.158899 Aug 30 01:21:48.601270 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 564/1169] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:48 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:49.622371 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-bfc60328-90d5-4da0-879f-799c52be9d86 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:49.622918 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-bfc60328-90d5-4da0-879f-799c52be9d86 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:49.630416 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bfc60328-90d5-4da0-879f-799c52be9d86 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:49.630897 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bfc60328-90d5-4da0-879f-799c52be9d86 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:49.631329 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bfc60328-90d5-4da0-879f-799c52be9d86 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:49.632041 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bfc60328-90d5-4da0-879f-799c52be9d86 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:49.632525 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bfc60328-90d5-4da0-879f-799c52be9d86 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:49.632944 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bfc60328-90d5-4da0-879f-799c52be9d86 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:49.767753 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-bfc60328-90d5-4da0-879f-799c52be9d86 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:49.775601 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-bfc60328-90d5-4da0-879f-799c52be9d86 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1575 microversion: 2.1 time: 0.157259 Aug 30 01:21:49.776177 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 606/1170] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:49 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:50.796425 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4f9b6489-c94c-4556-99e9-794cc503b34d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:50.797040 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4f9b6489-c94c-4556-99e9-794cc503b34d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:50.803608 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f9b6489-c94c-4556-99e9-794cc503b34d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:50.804097 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f9b6489-c94c-4556-99e9-794cc503b34d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:50.804550 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f9b6489-c94c-4556-99e9-794cc503b34d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:50.805240 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f9b6489-c94c-4556-99e9-794cc503b34d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:50.805699 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f9b6489-c94c-4556-99e9-794cc503b34d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:50.806162 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f9b6489-c94c-4556-99e9-794cc503b34d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:50.947849 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4f9b6489-c94c-4556-99e9-794cc503b34d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:50.957920 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4f9b6489-c94c-4556-99e9-794cc503b34d tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1575 microversion: 2.1 time: 0.165282 Aug 30 01:21:50.958811 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 565/1171] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:50 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:51.775833 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-8c8c713f-2db4-4d49-b23c-73b3472a1d56 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:51.776369 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-8c8c713f-2db4-4d49-b23c-73b3472a1d56 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:51.784058 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8c8c713f-2db4-4d49-b23c-73b3472a1d56 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:51.784548 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8c8c713f-2db4-4d49-b23c-73b3472a1d56 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:51.784981 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8c8c713f-2db4-4d49-b23c-73b3472a1d56 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:51.785694 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8c8c713f-2db4-4d49-b23c-73b3472a1d56 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:51.786175 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8c8c713f-2db4-4d49-b23c-73b3472a1d56 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:51.786602 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-8c8c713f-2db4-4d49-b23c-73b3472a1d56 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:51.870387 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-8c8c713f-2db4-4d49-b23c-73b3472a1d56 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lazy-loading 'services' on Instance uuid c083502b-4d9b-42b8-828c-55e3009467ea {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:21:52.000081 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0f550bce-87a0-4178-b1e7-a43156198f2f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:52.000740 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0f550bce-87a0-4178-b1e7-a43156198f2f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:52.007442 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0f550bce-87a0-4178-b1e7-a43156198f2f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:52.007866 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0f550bce-87a0-4178-b1e7-a43156198f2f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:52.008309 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0f550bce-87a0-4178-b1e7-a43156198f2f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:52.009005 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0f550bce-87a0-4178-b1e7-a43156198f2f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:52.009466 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0f550bce-87a0-4178-b1e7-a43156198f2f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:52.009951 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0f550bce-87a0-4178-b1e7-a43156198f2f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:52.160524 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0f550bce-87a0-4178-b1e7-a43156198f2f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:52.168511 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0f550bce-87a0-4178-b1e7-a43156198f2f tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1575 microversion: 2.1 time: 0.172270 Aug 30 01:21:52.169098 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 566/1172] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:51 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:21:52.222991 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-8c8c713f-2db4-4d49-b23c-73b3472a1d56 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea/os-volume_attachments/b71840c6-72cb-44bb-a078-be8fe8028f38" status: 202 len: 0 microversion: 2.1 time: 0.450862 Aug 30 01:21:52.223616 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 607/1173] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 30 01:21:51 2022] DELETE /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea/os-volume_attachments/b71840c6-72cb-44bb-a078-be8fe8028f38 => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:21:53.190867 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cd7fd6a4-c690-40ca-94e4-438adfbf0ae1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:53.191455 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cd7fd6a4-c690-40ca-94e4-438adfbf0ae1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:53.197892 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd7fd6a4-c690-40ca-94e4-438adfbf0ae1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:53.198378 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd7fd6a4-c690-40ca-94e4-438adfbf0ae1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:53.198820 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd7fd6a4-c690-40ca-94e4-438adfbf0ae1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:53.199516 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd7fd6a4-c690-40ca-94e4-438adfbf0ae1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:53.199977 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd7fd6a4-c690-40ca-94e4-438adfbf0ae1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:53.200407 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cd7fd6a4-c690-40ca-94e4-438adfbf0ae1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:53.335038 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cd7fd6a4-c690-40ca-94e4-438adfbf0ae1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:53.343161 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cd7fd6a4-c690-40ca-94e4-438adfbf0ae1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1575 microversion: 2.1 time: 0.156790 Aug 30 01:21:53.343729 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 567/1174] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:53 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:54.280902 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-920792a0-ff53-43a6-80e9-d9af243c2cf4 req-b435cdbe-ccf7-463d-8e73-715cd794878c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e28fa016-241d-473f-9697-13ab6e06fa91", "name": "network-vif-plugged", "status": "completed", "tag": "c4e6504b-45ee-4446-8a10-2c25ab5d86a4"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:54.291867 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-920792a0-ff53-43a6-80e9-d9af243c2cf4 req-b435cdbe-ccf7-463d-8e73-715cd794878c service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:54.292352 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-920792a0-ff53-43a6-80e9-d9af243c2cf4 req-b435cdbe-ccf7-463d-8e73-715cd794878c service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:54.292785 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-920792a0-ff53-43a6-80e9-d9af243c2cf4 req-b435cdbe-ccf7-463d-8e73-715cd794878c service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:54.305082 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-920792a0-ff53-43a6-80e9-d9af243c2cf4 req-b435cdbe-ccf7-463d-8e73-715cd794878c service nova] Creating event network-vif-plugged:c4e6504b-45ee-4446-8a10-2c25ab5d86a4 for instance e28fa016-241d-473f-9697-13ab6e06fa91 on hv-cinder-81571 Aug 30 01:21:54.310063 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-920792a0-ff53-43a6-80e9-d9af243c2cf4 req-b435cdbe-ccf7-463d-8e73-715cd794878c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033792 Aug 30 01:21:54.310805 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 608/1175] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:21:54.371118 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c6f3c204-96f8-49bb-9fdf-b2d38df64275 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:54.371741 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c6f3c204-96f8-49bb-9fdf-b2d38df64275 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:54.382273 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6f3c204-96f8-49bb-9fdf-b2d38df64275 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:54.383508 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6f3c204-96f8-49bb-9fdf-b2d38df64275 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:54.385581 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6f3c204-96f8-49bb-9fdf-b2d38df64275 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:54.386514 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6f3c204-96f8-49bb-9fdf-b2d38df64275 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:54.387349 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6f3c204-96f8-49bb-9fdf-b2d38df64275 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:54.389084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c6f3c204-96f8-49bb-9fdf-b2d38df64275 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:54.411433 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-02b8a162-f285-4887-a251-01b8e5ffe05c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:54.412793 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-02b8a162-f285-4887-a251-01b8e5ffe05c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:54.419366 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-02b8a162-f285-4887-a251-01b8e5ffe05c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:54.420172 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-02b8a162-f285-4887-a251-01b8e5ffe05c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:54.420902 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-02b8a162-f285-4887-a251-01b8e5ffe05c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:54.421861 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-02b8a162-f285-4887-a251-01b8e5ffe05c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:54.422699 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-02b8a162-f285-4887-a251-01b8e5ffe05c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:54.423330 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-02b8a162-f285-4887-a251-01b8e5ffe05c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:54.454640 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-02b8a162-f285-4887-a251-01b8e5ffe05c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Going to try to terminate instance {{(pid=121233) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:21:54.614014 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c6f3c204-96f8-49bb-9fdf-b2d38df64275 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:54.622234 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c6f3c204-96f8-49bb-9fdf-b2d38df64275 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1575 microversion: 2.1 time: 0.255846 Aug 30 01:21:54.622915 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 568/1176] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:54 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1575 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:54.818465 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-02b8a162-f285-4887-a251-01b8e5ffe05c tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 204 len: 0 microversion: 2.1 time: 0.412234 Aug 30 01:21:54.819229 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 609/1177] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:21:54 2022] DELETE /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 01:21:54.827649 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-07ccea9f-3901-480f-baf4-f2c958b7506d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:54.829121 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-07ccea9f-3901-480f-baf4-f2c958b7506d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:54.835980 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07ccea9f-3901-480f-baf4-f2c958b7506d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:54.836601 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07ccea9f-3901-480f-baf4-f2c958b7506d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:54.837119 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07ccea9f-3901-480f-baf4-f2c958b7506d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:54.838052 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07ccea9f-3901-480f-baf4-f2c958b7506d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:54.838513 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07ccea9f-3901-480f-baf4-f2c958b7506d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:54.838953 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-07ccea9f-3901-480f-baf4-f2c958b7506d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:54.971475 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-07ccea9f-3901-480f-baf4-f2c958b7506d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:54.979441 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-07ccea9f-3901-480f-baf4-f2c958b7506d tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1512 microversion: 2.1 time: 0.155816 Aug 30 01:21:54.980016 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 569/1178] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:54 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:55.644936 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e3d746cb-f5c4-4818-941f-ec62f8a93ef1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:55.645643 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e3d746cb-f5c4-4818-941f-ec62f8a93ef1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:55.652183 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e3d746cb-f5c4-4818-941f-ec62f8a93ef1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:55.652664 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e3d746cb-f5c4-4818-941f-ec62f8a93ef1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:55.653101 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e3d746cb-f5c4-4818-941f-ec62f8a93ef1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:55.653825 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e3d746cb-f5c4-4818-941f-ec62f8a93ef1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:55.654284 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e3d746cb-f5c4-4818-941f-ec62f8a93ef1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:55.654709 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e3d746cb-f5c4-4818-941f-ec62f8a93ef1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:55.790592 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-e3d746cb-f5c4-4818-941f-ec62f8a93ef1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:55.797795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e3d746cb-f5c4-4818-941f-ec62f8a93ef1 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1575 microversion: 2.1 time: 0.157133 Aug 30 01:21:55.798371 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 610/1179] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:55 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:56.000456 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1349a85e-6836-4554-a576-302a4e088060 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:56.001111 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1349a85e-6836-4554-a576-302a4e088060 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:56.007694 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1349a85e-6836-4554-a576-302a4e088060 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:56.008181 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1349a85e-6836-4554-a576-302a4e088060 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:56.008625 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1349a85e-6836-4554-a576-302a4e088060 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:56.009324 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1349a85e-6836-4554-a576-302a4e088060 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:56.009814 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1349a85e-6836-4554-a576-302a4e088060 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:56.010251 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1349a85e-6836-4554-a576-302a4e088060 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:56.141158 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1349a85e-6836-4554-a576-302a4e088060 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:56.149082 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1349a85e-6836-4554-a576-302a4e088060 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1512 microversion: 2.1 time: 0.152524 Aug 30 01:21:56.149660 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 570/1180] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:55 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:56.820057 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d94a899b-3ff6-4875-b6a3-185808fc8da3 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:56.820673 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d94a899b-3ff6-4875-b6a3-185808fc8da3 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:56.827212 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d94a899b-3ff6-4875-b6a3-185808fc8da3 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:56.827706 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d94a899b-3ff6-4875-b6a3-185808fc8da3 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:56.828128 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d94a899b-3ff6-4875-b6a3-185808fc8da3 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:56.828815 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d94a899b-3ff6-4875-b6a3-185808fc8da3 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:56.829268 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d94a899b-3ff6-4875-b6a3-185808fc8da3 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:56.829690 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d94a899b-3ff6-4875-b6a3-185808fc8da3 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:56.976817 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d94a899b-3ff6-4875-b6a3-185808fc8da3 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:56.984489 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d94a899b-3ff6-4875-b6a3-185808fc8da3 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1575 microversion: 2.1 time: 0.168423 Aug 30 01:21:56.985490 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 611/1181] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:56 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:57.170880 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-adcf856d-d998-42d1-914a-d9050278a3ab tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:57.171441 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-adcf856d-d998-42d1-914a-d9050278a3ab tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:57.178292 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-adcf856d-d998-42d1-914a-d9050278a3ab tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:57.178782 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-adcf856d-d998-42d1-914a-d9050278a3ab tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:57.179225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-adcf856d-d998-42d1-914a-d9050278a3ab tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:57.179920 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-adcf856d-d998-42d1-914a-d9050278a3ab tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:57.180382 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-adcf856d-d998-42d1-914a-d9050278a3ab tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:57.180824 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-adcf856d-d998-42d1-914a-d9050278a3ab tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:57.318648 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-adcf856d-d998-42d1-914a-d9050278a3ab tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:57.326399 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-adcf856d-d998-42d1-914a-d9050278a3ab tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1512 microversion: 2.1 time: 0.159488 Aug 30 01:21:57.326973 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 571/1182] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:57 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:58.005869 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d0638255-9116-44a4-b40a-7ad3b034bef5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:58.006525 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d0638255-9116-44a4-b40a-7ad3b034bef5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:58.012670 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0638255-9116-44a4-b40a-7ad3b034bef5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:58.013161 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0638255-9116-44a4-b40a-7ad3b034bef5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:58.013601 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0638255-9116-44a4-b40a-7ad3b034bef5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:58.014334 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0638255-9116-44a4-b40a-7ad3b034bef5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:58.014792 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0638255-9116-44a4-b40a-7ad3b034bef5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:58.015262 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d0638255-9116-44a4-b40a-7ad3b034bef5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:58.057255 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-eb43e5a0-da7a-4f2e-ac3e-3efe8d619472 req-c745e600-cef8-4a62-bb60-94cc8dea8dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c083502b-4d9b-42b8-828c-55e3009467ea", "name": "network-vif-deleted", "tag": "cf35a532-38e2-4463-bdd1-18a2d56537e0"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:21:58.067672 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-eb43e5a0-da7a-4f2e-ac3e-3efe8d619472 req-c745e600-cef8-4a62-bb60-94cc8dea8dc7 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:58.072696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-eb43e5a0-da7a-4f2e-ac3e-3efe8d619472 req-c745e600-cef8-4a62-bb60-94cc8dea8dc7 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:58.072696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-eb43e5a0-da7a-4f2e-ac3e-3efe8d619472 req-c745e600-cef8-4a62-bb60-94cc8dea8dc7 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:58.080397 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-eb43e5a0-da7a-4f2e-ac3e-3efe8d619472 req-c745e600-cef8-4a62-bb60-94cc8dea8dc7 service nova] Creating event network-vif-deleted:cf35a532-38e2-4463-bdd1-18a2d56537e0 for instance c083502b-4d9b-42b8-828c-55e3009467ea on hv-cinder-81571 Aug 30 01:21:58.087423 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-eb43e5a0-da7a-4f2e-ac3e-3efe8d619472 req-c745e600-cef8-4a62-bb60-94cc8dea8dc7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100165 Aug 30 01:21:58.087857 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 612/1183] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:21:58.165653 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d0638255-9116-44a4-b40a-7ad3b034bef5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:58.173432 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d0638255-9116-44a4-b40a-7ad3b034bef5 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1562 microversion: 2.1 time: 0.172056 Aug 30 01:21:58.174107 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 572/1184] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:58 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:21:58.347877 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4f7f6bb5-8c2c-4a96-a6f1-3abbcd09a699 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:58.348732 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4f7f6bb5-8c2c-4a96-a6f1-3abbcd09a699 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:58.355269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f7f6bb5-8c2c-4a96-a6f1-3abbcd09a699 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:58.356263 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f7f6bb5-8c2c-4a96-a6f1-3abbcd09a699 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:58.356263 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f7f6bb5-8c2c-4a96-a6f1-3abbcd09a699 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:58.356860 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f7f6bb5-8c2c-4a96-a6f1-3abbcd09a699 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:58.357308 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f7f6bb5-8c2c-4a96-a6f1-3abbcd09a699 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:58.357871 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f7f6bb5-8c2c-4a96-a6f1-3abbcd09a699 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:58.422663 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4f7f6bb5-8c2c-4a96-a6f1-3abbcd09a699 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:58.431543 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4f7f6bb5-8c2c-4a96-a6f1-3abbcd09a699 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1303 microversion: 2.1 time: 0.087883 Aug 30 01:21:58.432125 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 613/1185] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:58 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1303 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:21:59.452998 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dd5c192b-c25d-4fe7-a5c7-cb260164d5cd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:21:59.454442 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dd5c192b-c25d-4fe7-a5c7-cb260164d5cd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:21:59.462013 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd5c192b-c25d-4fe7-a5c7-cb260164d5cd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:59.462502 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd5c192b-c25d-4fe7-a5c7-cb260164d5cd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:59.462943 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd5c192b-c25d-4fe7-a5c7-cb260164d5cd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:59.463645 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd5c192b-c25d-4fe7-a5c7-cb260164d5cd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:59.464106 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd5c192b-c25d-4fe7-a5c7-cb260164d5cd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:59.464536 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd5c192b-c25d-4fe7-a5c7-cb260164d5cd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:59.499179 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd5c192b-c25d-4fe7-a5c7-cb260164d5cd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:21:59.499668 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd5c192b-c25d-4fe7-a5c7-cb260164d5cd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:21:59.500102 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd5c192b-c25d-4fe7-a5c7-cb260164d5cd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:21:59.500559 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-dd5c192b-c25d-4fe7-a5c7-cb260164d5cd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lazy-loading 'fault' on Instance uuid c083502b-4d9b-42b8-828c-55e3009467ea {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:21:59.542977 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dd5c192b-c25d-4fe7-a5c7-cb260164d5cd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998bb52979154fdc824ec07589df82c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb93b63909346cbab03513b7707f7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:21:59.550303 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dd5c192b-c25d-4fe7-a5c7-cb260164d5cd tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 200 len: 1308 microversion: 2.1 time: 0.101290 Aug 30 01:21:59.551167 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 573/1186] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:21:59 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:00.571794 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-300e500c-0874-4f04-ade2-2ab7587711a1 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:00.572431 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-300e500c-0874-4f04-ade2-2ab7587711a1 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] [instance: c083502b-4d9b-42b8-828c-55e3009467ea] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:00.579109 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-300e500c-0874-4f04-ade2-2ab7587711a1 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:00.579596 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-300e500c-0874-4f04-ade2-2ab7587711a1 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:00.580032 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-300e500c-0874-4f04-ade2-2ab7587711a1 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:00.580726 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-300e500c-0874-4f04-ade2-2ab7587711a1 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:00.581182 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-300e500c-0874-4f04-ade2-2ab7587711a1 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:00.581608 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-300e500c-0874-4f04-ade2-2ab7587711a1 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:00.586348 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:00.595968 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-300e500c-0874-4f04-ade2-2ab7587711a1 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] HTTP exception thrown: Instance c083502b-4d9b-42b8-828c-55e3009467ea could not be found. Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-300e500c-0874-4f04-ade2-2ab7587711a1 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Request method failure captured: Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea HTTP/1.1 Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWW_iHHpPYZlHkuKssRpOlvcvTsXvSyyWhuasuJ1fBUwivyE9rCtdYJqo2OCFtkVdpZQVK1xaGSqRupQN-p4BJFYyWOHHXBVynIj3CRlNp8aEWVxkLGA5OKnZ5BrYrw162Y3iv0h6lnCyDe4s_fGz6korzpRHL-8fEthdIA7ZdyhalA Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 6bb93b63909346cbab03513b7707f7b8 Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1910596305 Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:22:00.597630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:22:00.605486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bb93b63909346cbab03513b7707f7b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bb93b63909346cbab03513b7707f7b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bb93b63909346cbab03513b7707f7b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bb93b63909346cbab03513b7707f7b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:22:00.605486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-VolumesSnapshotTestJSON-1910596305 Aug 30 01:22:00.605486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 6bb93b63909346cbab03513b7707f7b8 Aug 30 01:22:00.605486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1910596305 Aug 30 01:22:00.605486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-VolumesSnapshotTestJSON-1910596305-project Aug 30 01:22:00.605486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:22:00.605486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:22:00.605486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 998bb52979154fdc824ec07589df82c6 Aug 30 01:22:00.605486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-VolumesSnapshotTestJSON-1910596305-project Aug 30 01:22:00.605486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:22:00.605486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance c083502b-4d9b-42b8-828c-55e3009467ea could not be found. Aug 30 01:22:00.605486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': 'c083502b-4d9b-42b8-828c-55e3009467ea'} Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c083502b-4d9b-42b8-828c-55e3009467ea could not be found. Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:22:00.606392 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c083502b-4d9b-42b8-828c-55e3009467ea could not be found. Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c083502b-4d9b-42b8-828c-55e3009467ea could not be found. Aug 30 01:22:00.607811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:22:00.609080 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-300e500c-0874-4f04-ade2-2ab7587711a1 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] Returning 404 to user: Instance c083502b-4d9b-42b8-828c-55e3009467ea could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:22:00.609080 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-300e500c-0874-4f04-ade2-2ab7587711a1 tempest-VolumesSnapshotTestJSON-1910596305 tempest-VolumesSnapshotTestJSON-1910596305-project] 10.222.0.52 "GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea" status: 404 len: 111 microversion: 2.1 time: 0.031332 Aug 30 01:22:00.609080 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 614/1187] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:00 2022] GET /compute/v2.1/servers/c083502b-4d9b-42b8-828c-55e3009467ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:22:34.974608 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c4479bcd-e8b0-4e00-b6cb-757de3084ed6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:34.975225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c4479bcd-e8b0-4e00-b6cb-757de3084ed6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:34.977310 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=21 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:34.977982 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=98 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:34.984386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4479bcd-e8b0-4e00-b6cb-757de3084ed6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:34.984856 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4479bcd-e8b0-4e00-b6cb-757de3084ed6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:34.985288 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4479bcd-e8b0-4e00-b6cb-757de3084ed6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:34.986045 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4479bcd-e8b0-4e00-b6cb-757de3084ed6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:34.986496 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4479bcd-e8b0-4e00-b6cb-757de3084ed6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:34.986916 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4479bcd-e8b0-4e00-b6cb-757de3084ed6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:35.012410 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c4479bcd-e8b0-4e00-b6cb-757de3084ed6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:22:35.478708 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c4479bcd-e8b0-4e00-b6cb-757de3084ed6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 204 len: 0 microversion: 2.1 time: 0.507900 Aug 30 01:22:35.479303 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 574/1188] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:22:34 2022] DELETE /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:22:35.489270 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-384d9a4f-aab8-4ae9-a87d-5e3c80161682 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:35.489270 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-384d9a4f-aab8-4ae9-a87d-5e3c80161682 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:35.490744 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:35.495841 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-384d9a4f-aab8-4ae9-a87d-5e3c80161682 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:35.496317 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-384d9a4f-aab8-4ae9-a87d-5e3c80161682 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:35.496748 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-384d9a4f-aab8-4ae9-a87d-5e3c80161682 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:35.497437 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-384d9a4f-aab8-4ae9-a87d-5e3c80161682 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:35.497923 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-384d9a4f-aab8-4ae9-a87d-5e3c80161682 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:35.498342 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-384d9a4f-aab8-4ae9-a87d-5e3c80161682 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:35.629998 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-384d9a4f-aab8-4ae9-a87d-5e3c80161682 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:35.637911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-384d9a4f-aab8-4ae9-a87d-5e3c80161682 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1576 microversion: 2.1 time: 0.154231 Aug 30 01:22:35.638487 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 615/1189] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:35 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:36.661311 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c3a7b270-62be-46cb-bad5-493b65a7d103 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:36.662006 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c3a7b270-62be-46cb-bad5-493b65a7d103 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:36.668929 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3a7b270-62be-46cb-bad5-493b65a7d103 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:36.669428 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3a7b270-62be-46cb-bad5-493b65a7d103 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:36.669910 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3a7b270-62be-46cb-bad5-493b65a7d103 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:36.670609 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3a7b270-62be-46cb-bad5-493b65a7d103 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:36.671113 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3a7b270-62be-46cb-bad5-493b65a7d103 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:36.671541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c3a7b270-62be-46cb-bad5-493b65a7d103 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:36.808253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c3a7b270-62be-46cb-bad5-493b65a7d103 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:36.816193 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c3a7b270-62be-46cb-bad5-493b65a7d103 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1576 microversion: 2.1 time: 0.160325 Aug 30 01:22:36.816764 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 575/1190] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:36 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:37.838729 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-583d255e-102b-4270-93e7-f16f3c6773cd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:37.839356 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-583d255e-102b-4270-93e7-f16f3c6773cd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:37.847719 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-583d255e-102b-4270-93e7-f16f3c6773cd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:37.848211 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-583d255e-102b-4270-93e7-f16f3c6773cd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:37.848699 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-583d255e-102b-4270-93e7-f16f3c6773cd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:37.849417 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-583d255e-102b-4270-93e7-f16f3c6773cd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:37.849912 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-583d255e-102b-4270-93e7-f16f3c6773cd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:37.850345 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-583d255e-102b-4270-93e7-f16f3c6773cd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:37.986594 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-583d255e-102b-4270-93e7-f16f3c6773cd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:37.995008 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-583d255e-102b-4270-93e7-f16f3c6773cd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1576 microversion: 2.1 time: 0.160904 Aug 30 01:22:37.995603 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 616/1191] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:37 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:38.315477 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-f4ff95ed-e2c4-4221-a820-defaaf456a7e req-8cf6e49c-52f8-453a-a08e-b92a4b3d6f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9", "name": "network-vif-deleted", "tag": "fd271197-9d24-4e46-858e-e54a62ef8533"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:38.332865 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f4ff95ed-e2c4-4221-a820-defaaf456a7e req-8cf6e49c-52f8-453a-a08e-b92a4b3d6f5f service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:38.333310 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f4ff95ed-e2c4-4221-a820-defaaf456a7e req-8cf6e49c-52f8-453a-a08e-b92a4b3d6f5f service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:38.333927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f4ff95ed-e2c4-4221-a820-defaaf456a7e req-8cf6e49c-52f8-453a-a08e-b92a4b3d6f5f service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:38.348145 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-f4ff95ed-e2c4-4221-a820-defaaf456a7e req-8cf6e49c-52f8-453a-a08e-b92a4b3d6f5f service nova] Creating event network-vif-deleted:fd271197-9d24-4e46-858e-e54a62ef8533 for instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 on hv-cinder-81571 Aug 30 01:22:38.353374 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-f4ff95ed-e2c4-4221-a820-defaaf456a7e req-8cf6e49c-52f8-453a-a08e-b92a4b3d6f5f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042122 Aug 30 01:22:38.354322 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 576/1192] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:39.017259 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f7746182-4b84-4195-9c5e-d07f2c20f16b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:39.017971 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f7746182-4b84-4195-9c5e-d07f2c20f16b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:39.025281 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7746182-4b84-4195-9c5e-d07f2c20f16b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:39.025803 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7746182-4b84-4195-9c5e-d07f2c20f16b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:39.026243 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7746182-4b84-4195-9c5e-d07f2c20f16b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:39.026982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7746182-4b84-4195-9c5e-d07f2c20f16b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:39.027433 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7746182-4b84-4195-9c5e-d07f2c20f16b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:39.027852 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7746182-4b84-4195-9c5e-d07f2c20f16b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:39.068565 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7746182-4b84-4195-9c5e-d07f2c20f16b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:39.069043 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7746182-4b84-4195-9c5e-d07f2c20f16b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:39.069654 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f7746182-4b84-4195-9c5e-d07f2c20f16b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:39.070340 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-f7746182-4b84-4195-9c5e-d07f2c20f16b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lazy-loading 'fault' on Instance uuid cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:22:39.114792 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f7746182-4b84-4195-9c5e-d07f2c20f16b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:39.123711 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f7746182-4b84-4195-9c5e-d07f2c20f16b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 200 len: 1229 microversion: 2.1 time: 0.110537 Aug 30 01:22:39.124050 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 617/1193] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:39 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 1229 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:22:40.151959 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cda4a30a-0faf-4ce4-896d-bb53c21f516d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:40.152682 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cda4a30a-0faf-4ce4-896d-bb53c21f516d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:40.160673 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cda4a30a-0faf-4ce4-896d-bb53c21f516d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:40.161154 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cda4a30a-0faf-4ce4-896d-bb53c21f516d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:40.161594 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cda4a30a-0faf-4ce4-896d-bb53c21f516d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.162361 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cda4a30a-0faf-4ce4-896d-bb53c21f516d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:40.162817 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cda4a30a-0faf-4ce4-896d-bb53c21f516d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:40.163250 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cda4a30a-0faf-4ce4-896d-bb53c21f516d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.177556 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-cda4a30a-0faf-4ce4-896d-bb53c21f516d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] HTTP exception thrown: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cda4a30a-0faf-4ce4-896d-bb53c21f516d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Request method failure captured: Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 HTTP/1.1 Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWWpLAr9Wxt0wzX8nbUp73PagpL6fegcCe0t6pbZeQKLKB3l6OKWJW4BNxRPapRDvkRaK8wMBFjGPNKBt1-gQCF70ZlfsSgzXwofZbj9g7www7kZrpfJXDAcMM3v88TXFyLCWIpba5Ht5dExUdYoBPLVSlZvbG-BSUVeDzCtSM5Kiyg Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 3068817b4ca34beca8bd4da5409e58ef Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-TestVolumeBootPattern-1512577343 Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:22:40.179235 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:22:40.180999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:22:40.180999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-TestVolumeBootPattern-1512577343 Aug 30 01:22:40.180999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 3068817b4ca34beca8bd4da5409e58ef Aug 30 01:22:40.180999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-TestVolumeBootPattern-1512577343 Aug 30 01:22:40.180999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-TestVolumeBootPattern-1512577343-project Aug 30 01:22:40.180999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:22:40.180999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:22:40.180999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: b5b9eb7e61704da582a326e48e3a5170 Aug 30 01:22:40.180999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-TestVolumeBootPattern-1512577343-project Aug 30 01:22:40.180999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:22:40.180999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. Aug 30 01:22:40.180999 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': 'cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9'} Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:22:40.182050 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. Aug 30 01:22:40.183478 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:22:40.184740 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cda4a30a-0faf-4ce4-896d-bb53c21f516d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Returning 404 to user: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:22:40.184740 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cda4a30a-0faf-4ce4-896d-bb53c21f516d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 404 len: 111 microversion: 2.1 time: 0.033036 Aug 30 01:22:40.184740 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 577/1194] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:40 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:22:40.282432 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1905717370", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-399237452", "security_groups": [{"name": "tempest-secgroup-smoke-1826305638"}], "block_device_mapping_v2": [{"uuid": "b4edce21-fd13-4046-a82b-0c9ff87ca5c6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8c6152a9-22c5-47c3-b922-7c52df366312"}]}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:40.401325 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.network.neutron [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] validate_networks() for [('8c6152a9-22c5-47c3-b922-7c52df366312', None, None, None, None, None)] {{(pid=121233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:22:40.782747 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Flavor limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:22:40.783171 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Image limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:22:40.783690 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Flavor pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:22:40.784102 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Image pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:22:40.784516 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:22:40.793443 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:40.793952 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:40.794390 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.795107 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:40.795558 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:40.795976 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:40.813604 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Getting quotas for project 3068817b4ca34beca8bd4da5409e58ef. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:22:40.817572 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Getting quotas for user b5b9eb7e61704da582a326e48e3a5170 and project 3068817b4ca34beca8bd4da5409e58ef. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:22:40.874218 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Going to run 1 instances... {{(pid=121233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:22:40.876865 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b4edce21-fd13-4046-a82b-0c9ff87ca5c6',volume_size=None,volume_type=None)] {{(pid=121233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:22:41.266648 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-0c792e29-8102-41ba-9aa6-0ea61b735356 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.989114 Aug 30 01:22:41.267551 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 618/1195] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:22:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:22:41.278092 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0519e439-cb7e-4943-8806-fdac16f05dab tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:41.278710 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0519e439-cb7e-4943-8806-fdac16f05dab tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:41.348308 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0519e439-cb7e-4943-8806-fdac16f05dab tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:41.356155 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0519e439-cb7e-4943-8806-fdac16f05dab tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1094 microversion: 2.1 time: 0.081836 Aug 30 01:22:41.356728 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 578/1196] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:41 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:42.380793 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d5390b32-50e0-465a-b48b-512ced9a1320 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:42.381422 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d5390b32-50e0-465a-b48b-512ced9a1320 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:42.388965 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d5390b32-50e0-465a-b48b-512ced9a1320 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:42.389486 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d5390b32-50e0-465a-b48b-512ced9a1320 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:42.389977 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d5390b32-50e0-465a-b48b-512ced9a1320 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:42.390920 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d5390b32-50e0-465a-b48b-512ced9a1320 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:42.391381 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d5390b32-50e0-465a-b48b-512ced9a1320 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:42.391811 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d5390b32-50e0-465a-b48b-512ced9a1320 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:42.463513 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d5390b32-50e0-465a-b48b-512ced9a1320 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:42.472347 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d5390b32-50e0-465a-b48b-512ced9a1320 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1144 microversion: 2.1 time: 0.099003 Aug 30 01:22:42.472933 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 619/1197] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:42 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1144 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:43.493270 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b6fa878b-6d21-4355-b672-c98b2e9ea2b6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:43.493934 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b6fa878b-6d21-4355-b672-c98b2e9ea2b6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:43.501670 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6fa878b-6d21-4355-b672-c98b2e9ea2b6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:43.503516 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6fa878b-6d21-4355-b672-c98b2e9ea2b6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:43.504472 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6fa878b-6d21-4355-b672-c98b2e9ea2b6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:43.505216 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6fa878b-6d21-4355-b672-c98b2e9ea2b6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:43.505695 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6fa878b-6d21-4355-b672-c98b2e9ea2b6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:43.506151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6fa878b-6d21-4355-b672-c98b2e9ea2b6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:43.590991 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b6fa878b-6d21-4355-b672-c98b2e9ea2b6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:43.598840 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b6fa878b-6d21-4355-b672-c98b2e9ea2b6 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1200 microversion: 2.1 time: 0.109696 Aug 30 01:22:43.599549 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 579/1198] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:43 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1200 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:44.620545 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-63ea772e-e154-47fa-a025-da81c26314c5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:44.622009 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-63ea772e-e154-47fa-a025-da81c26314c5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:44.631569 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63ea772e-e154-47fa-a025-da81c26314c5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:44.633349 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63ea772e-e154-47fa-a025-da81c26314c5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:44.634052 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63ea772e-e154-47fa-a025-da81c26314c5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:44.635297 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63ea772e-e154-47fa-a025-da81c26314c5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:44.636073 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63ea772e-e154-47fa-a025-da81c26314c5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:44.636694 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-63ea772e-e154-47fa-a025-da81c26314c5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:44.781656 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-63ea772e-e154-47fa-a025-da81c26314c5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:44.790840 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-63ea772e-e154-47fa-a025-da81c26314c5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1278 microversion: 2.1 time: 0.174306 Aug 30 01:22:44.795083 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 620/1199] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:44 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:45.280535 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-7f663b18-31db-496e-b6e9-3e3d91b60622 req-ebc5b9a2-922d-4422-8815-c2b0b26178ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc20f9c-35e3-4586-a419-82ed45c19481", "tag": "decc0218-8c0d-4f69-a8f7-06f0367b750c"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:45.291633 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-7f663b18-31db-496e-b6e9-3e3d91b60622 req-ebc5b9a2-922d-4422-8815-c2b0b26178ac service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:45.292114 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-7f663b18-31db-496e-b6e9-3e3d91b60622 req-ebc5b9a2-922d-4422-8815-c2b0b26178ac service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:45.293210 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-7f663b18-31db-496e-b6e9-3e3d91b60622 req-ebc5b9a2-922d-4422-8815-c2b0b26178ac service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:45.305449 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-7f663b18-31db-496e-b6e9-3e3d91b60622 req-ebc5b9a2-922d-4422-8815-c2b0b26178ac service nova] Creating event network-changed:decc0218-8c0d-4f69-a8f7-06f0367b750c for instance 7cc20f9c-35e3-4586-a419-82ed45c19481 on hv-cinder-81571 Aug 30 01:22:45.310658 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-7f663b18-31db-496e-b6e9-3e3d91b60622 req-ebc5b9a2-922d-4422-8815-c2b0b26178ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033765 Aug 30 01:22:45.311251 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 580/1200] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:22:45.812579 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-3ca0f348-4a75-4a33-9d1b-183af2cd19a2 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:45.813194 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-3ca0f348-4a75-4a33-9d1b-183af2cd19a2 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:45.819861 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3ca0f348-4a75-4a33-9d1b-183af2cd19a2 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:45.820345 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3ca0f348-4a75-4a33-9d1b-183af2cd19a2 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:45.820793 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3ca0f348-4a75-4a33-9d1b-183af2cd19a2 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:45.821487 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3ca0f348-4a75-4a33-9d1b-183af2cd19a2 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:45.822098 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3ca0f348-4a75-4a33-9d1b-183af2cd19a2 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:45.822402 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-3ca0f348-4a75-4a33-9d1b-183af2cd19a2 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:45.961523 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-3ca0f348-4a75-4a33-9d1b-183af2cd19a2 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:45.970354 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-3ca0f348-4a75-4a33-9d1b-183af2cd19a2 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1266 microversion: 2.1 time: 0.161668 Aug 30 01:22:45.970939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 621/1201] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:45 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:46.994175 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d9f394cf-103c-4c45-a3b5-d799d78e1e7a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:46.994924 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d9f394cf-103c-4c45-a3b5-d799d78e1e7a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:47.001302 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9f394cf-103c-4c45-a3b5-d799d78e1e7a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:47.001813 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9f394cf-103c-4c45-a3b5-d799d78e1e7a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:47.002260 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9f394cf-103c-4c45-a3b5-d799d78e1e7a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:47.002964 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9f394cf-103c-4c45-a3b5-d799d78e1e7a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:47.003424 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9f394cf-103c-4c45-a3b5-d799d78e1e7a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:47.003853 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9f394cf-103c-4c45-a3b5-d799d78e1e7a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:47.168201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d9f394cf-103c-4c45-a3b5-d799d78e1e7a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:47.176917 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d9f394cf-103c-4c45-a3b5-d799d78e1e7a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1266 microversion: 2.1 time: 0.187852 Aug 30 01:22:47.177495 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 581/1202] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:46 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:22:48.200551 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-60792f0f-1db3-48c4-b48a-fca205b33f93 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:48.201225 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-60792f0f-1db3-48c4-b48a-fca205b33f93 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:48.208324 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60792f0f-1db3-48c4-b48a-fca205b33f93 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:48.208861 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60792f0f-1db3-48c4-b48a-fca205b33f93 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:48.209301 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60792f0f-1db3-48c4-b48a-fca205b33f93 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:48.210015 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60792f0f-1db3-48c4-b48a-fca205b33f93 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:48.210476 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60792f0f-1db3-48c4-b48a-fca205b33f93 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:48.210899 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-60792f0f-1db3-48c4-b48a-fca205b33f93 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:48.344205 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-60792f0f-1db3-48c4-b48a-fca205b33f93 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:48.352009 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-60792f0f-1db3-48c4-b48a-fca205b33f93 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1266 microversion: 2.1 time: 0.155393 Aug 30 01:22:48.352586 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 622/1203] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:48 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:49.372838 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5b2006d8-5672-4de0-be0d-89227fb65c36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:49.373434 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5b2006d8-5672-4de0-be0d-89227fb65c36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:49.380533 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b2006d8-5672-4de0-be0d-89227fb65c36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:49.381065 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b2006d8-5672-4de0-be0d-89227fb65c36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:49.381505 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b2006d8-5672-4de0-be0d-89227fb65c36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:49.382228 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b2006d8-5672-4de0-be0d-89227fb65c36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:49.382686 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b2006d8-5672-4de0-be0d-89227fb65c36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:49.383115 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b2006d8-5672-4de0-be0d-89227fb65c36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:49.517215 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5b2006d8-5672-4de0-be0d-89227fb65c36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:49.525895 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5b2006d8-5672-4de0-be0d-89227fb65c36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1266 microversion: 2.1 time: 0.157053 Aug 30 01:22:49.526662 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 582/1204] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:49 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:50.546842 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-130b44a7-3d84-4f6b-807c-60e36d5c0ea8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:50.547460 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-130b44a7-3d84-4f6b-807c-60e36d5c0ea8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:50.554961 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-130b44a7-3d84-4f6b-807c-60e36d5c0ea8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:50.555440 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-130b44a7-3d84-4f6b-807c-60e36d5c0ea8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:50.555874 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-130b44a7-3d84-4f6b-807c-60e36d5c0ea8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:50.556569 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-130b44a7-3d84-4f6b-807c-60e36d5c0ea8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:50.557026 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-130b44a7-3d84-4f6b-807c-60e36d5c0ea8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:50.557451 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-130b44a7-3d84-4f6b-807c-60e36d5c0ea8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:50.690169 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-130b44a7-3d84-4f6b-807c-60e36d5c0ea8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:50.698851 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-130b44a7-3d84-4f6b-807c-60e36d5c0ea8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1266 microversion: 2.1 time: 0.155938 Aug 30 01:22:50.699429 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 623/1205] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:50 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:51.719644 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2e355c55-88b4-4b11-b181-52b5a5cca0b8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:51.720194 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2e355c55-88b4-4b11-b181-52b5a5cca0b8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:51.722607 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:51.727581 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e355c55-88b4-4b11-b181-52b5a5cca0b8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:51.728065 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e355c55-88b4-4b11-b181-52b5a5cca0b8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:51.728505 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e355c55-88b4-4b11-b181-52b5a5cca0b8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:51.729205 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e355c55-88b4-4b11-b181-52b5a5cca0b8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:51.729660 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e355c55-88b4-4b11-b181-52b5a5cca0b8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:51.730132 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e355c55-88b4-4b11-b181-52b5a5cca0b8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:51.865745 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2e355c55-88b4-4b11-b181-52b5a5cca0b8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:51.873749 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2e355c55-88b4-4b11-b181-52b5a5cca0b8 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1266 microversion: 2.1 time: 0.158271 Aug 30 01:22:51.874330 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 583/1206] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:51 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:52.894449 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-f0e68653-3378-4efc-88b9-229f69fc3866 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:52.895085 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-f0e68653-3378-4efc-88b9-229f69fc3866 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:52.897619 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=2 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:52.898431 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=6 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:22:52.903351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0e68653-3378-4efc-88b9-229f69fc3866 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:52.903888 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0e68653-3378-4efc-88b9-229f69fc3866 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:52.904329 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0e68653-3378-4efc-88b9-229f69fc3866 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:52.905020 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0e68653-3378-4efc-88b9-229f69fc3866 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:52.905749 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0e68653-3378-4efc-88b9-229f69fc3866 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:52.906180 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-f0e68653-3378-4efc-88b9-229f69fc3866 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:53.042017 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-f0e68653-3378-4efc-88b9-229f69fc3866 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:53.049980 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-f0e68653-3378-4efc-88b9-229f69fc3866 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1266 microversion: 2.1 time: 0.159601 Aug 30 01:22:53.050533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 624/1207] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:52 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:54.071418 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-48d3ae51-fe4b-469d-8c62-c8311bfd39d5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:54.072052 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-48d3ae51-fe4b-469d-8c62-c8311bfd39d5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:54.079243 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48d3ae51-fe4b-469d-8c62-c8311bfd39d5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:54.079767 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48d3ae51-fe4b-469d-8c62-c8311bfd39d5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:54.080203 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48d3ae51-fe4b-469d-8c62-c8311bfd39d5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:54.080924 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48d3ae51-fe4b-469d-8c62-c8311bfd39d5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:54.081401 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48d3ae51-fe4b-469d-8c62-c8311bfd39d5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:54.082227 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48d3ae51-fe4b-469d-8c62-c8311bfd39d5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:54.227232 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-48d3ae51-fe4b-469d-8c62-c8311bfd39d5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:54.234953 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-48d3ae51-fe4b-469d-8c62-c8311bfd39d5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1266 microversion: 2.1 time: 0.168037 Aug 30 01:22:54.235523 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 584/1208] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:54 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:55.256579 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-7fd6f775-fc51-47a9-92f9-6fb195af46f3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:55.257181 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-7fd6f775-fc51-47a9-92f9-6fb195af46f3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:55.263534 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7fd6f775-fc51-47a9-92f9-6fb195af46f3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:55.264011 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7fd6f775-fc51-47a9-92f9-6fb195af46f3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:55.264471 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7fd6f775-fc51-47a9-92f9-6fb195af46f3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:55.265157 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7fd6f775-fc51-47a9-92f9-6fb195af46f3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:55.265604 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7fd6f775-fc51-47a9-92f9-6fb195af46f3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:55.266071 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7fd6f775-fc51-47a9-92f9-6fb195af46f3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:55.398446 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7fd6f775-fc51-47a9-92f9-6fb195af46f3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:55.406428 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-7fd6f775-fc51-47a9-92f9-6fb195af46f3 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1266 microversion: 2.1 time: 0.153889 Aug 30 01:22:55.407013 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 625/1209] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:55 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:22:56.427457 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-05e239b7-4751-41ce-9fd3-f9d5aaffa279 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:56.427979 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-05e239b7-4751-41ce-9fd3-f9d5aaffa279 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:56.434573 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05e239b7-4751-41ce-9fd3-f9d5aaffa279 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:56.435086 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05e239b7-4751-41ce-9fd3-f9d5aaffa279 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:56.435527 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05e239b7-4751-41ce-9fd3-f9d5aaffa279 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:56.436220 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05e239b7-4751-41ce-9fd3-f9d5aaffa279 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:56.436681 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05e239b7-4751-41ce-9fd3-f9d5aaffa279 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:56.437106 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05e239b7-4751-41ce-9fd3-f9d5aaffa279 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:56.636265 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-05e239b7-4751-41ce-9fd3-f9d5aaffa279 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:56.644836 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-05e239b7-4751-41ce-9fd3-f9d5aaffa279 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1266 microversion: 2.1 time: 0.221407 Aug 30 01:22:56.645420 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 585/1210] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:56 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:56.724360 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-f66fc60e-aecc-4e77-b3a6-732c58ddfce8 req-18c1ac2e-401d-4494-bc20-8d7412ecd134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc20f9c-35e3-4586-a419-82ed45c19481", "name": "network-vif-plugged", "status": "completed", "tag": "decc0218-8c0d-4f69-a8f7-06f0367b750c"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:22:56.737476 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-f66fc60e-aecc-4e77-b3a6-732c58ddfce8 req-18c1ac2e-401d-4494-bc20-8d7412ecd134 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:56.738006 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-f66fc60e-aecc-4e77-b3a6-732c58ddfce8 req-18c1ac2e-401d-4494-bc20-8d7412ecd134 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:56.738530 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-f66fc60e-aecc-4e77-b3a6-732c58ddfce8 req-18c1ac2e-401d-4494-bc20-8d7412ecd134 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:56.750867 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-f66fc60e-aecc-4e77-b3a6-732c58ddfce8 req-18c1ac2e-401d-4494-bc20-8d7412ecd134 service nova] Creating event network-vif-plugged:decc0218-8c0d-4f69-a8f7-06f0367b750c for instance 7cc20f9c-35e3-4586-a419-82ed45c19481 on hv-cinder-81571 Aug 30 01:22:56.756254 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-f66fc60e-aecc-4e77-b3a6-732c58ddfce8 req-18c1ac2e-401d-4494-bc20-8d7412ecd134 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178853 Aug 30 01:22:56.757186 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 626/1211] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:22:57.665955 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1cd949e6-4e76-4466-8bbd-688e84d6888d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:57.666577 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1cd949e6-4e76-4466-8bbd-688e84d6888d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:57.673109 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cd949e6-4e76-4466-8bbd-688e84d6888d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:57.673599 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cd949e6-4e76-4466-8bbd-688e84d6888d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:57.674066 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cd949e6-4e76-4466-8bbd-688e84d6888d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:57.674759 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cd949e6-4e76-4466-8bbd-688e84d6888d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:57.675268 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cd949e6-4e76-4466-8bbd-688e84d6888d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:57.675694 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1cd949e6-4e76-4466-8bbd-688e84d6888d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:57.804701 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1cd949e6-4e76-4466-8bbd-688e84d6888d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:57.813147 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1cd949e6-4e76-4466-8bbd-688e84d6888d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1266 microversion: 2.1 time: 0.151280 Aug 30 01:22:57.813743 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 586/1212] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:57 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:22:58.834960 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-ee026150-7216-4e10-a830-f5e052babcc5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:22:58.835666 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-ee026150-7216-4e10-a830-f5e052babcc5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:22:58.842636 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee026150-7216-4e10-a830-f5e052babcc5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:58.843296 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee026150-7216-4e10-a830-f5e052babcc5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:58.843744 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee026150-7216-4e10-a830-f5e052babcc5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:58.844483 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee026150-7216-4e10-a830-f5e052babcc5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:22:58.844945 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee026150-7216-4e10-a830-f5e052babcc5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:22:58.845375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-ee026150-7216-4e10-a830-f5e052babcc5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:22:58.983217 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-ee026150-7216-4e10-a830-f5e052babcc5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:22:58.994532 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-ee026150-7216-4e10-a830-f5e052babcc5 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1266 microversion: 2.1 time: 0.163835 Aug 30 01:22:59.003518 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 627/1213] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:22:58 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:00.015127 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-750dfa8c-f5be-4a3d-881b-212b2e7a5107 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:00.015774 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-750dfa8c-f5be-4a3d-881b-212b2e7a5107 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:00.022277 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-750dfa8c-f5be-4a3d-881b-212b2e7a5107 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:00.022764 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-750dfa8c-f5be-4a3d-881b-212b2e7a5107 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:00.023202 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-750dfa8c-f5be-4a3d-881b-212b2e7a5107 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:00.023896 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-750dfa8c-f5be-4a3d-881b-212b2e7a5107 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:00.024886 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-750dfa8c-f5be-4a3d-881b-212b2e7a5107 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:00.025319 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-750dfa8c-f5be-4a3d-881b-212b2e7a5107 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:00.162428 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-750dfa8c-f5be-4a3d-881b-212b2e7a5107 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:00.171273 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-750dfa8c-f5be-4a3d-881b-212b2e7a5107 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1453 microversion: 2.1 time: 0.160020 Aug 30 01:23:00.171857 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 587/1214] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:00 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:00.195057 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4cd81d81-c30e-4e18-aa9f-470f996cb977 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:00.195672 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4cd81d81-c30e-4e18-aa9f-470f996cb977 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:00.202351 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4cd81d81-c30e-4e18-aa9f-470f996cb977 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:00.202830 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4cd81d81-c30e-4e18-aa9f-470f996cb977 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:00.203264 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4cd81d81-c30e-4e18-aa9f-470f996cb977 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:00.203952 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4cd81d81-c30e-4e18-aa9f-470f996cb977 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:00.204405 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4cd81d81-c30e-4e18-aa9f-470f996cb977 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:00.204826 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4cd81d81-c30e-4e18-aa9f-470f996cb977 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:00.339924 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4cd81d81-c30e-4e18-aa9f-470f996cb977 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:00.353271 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4cd81d81-c30e-4e18-aa9f-470f996cb977 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1453 microversion: 2.1 time: 0.161215 Aug 30 01:23:00.354106 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 628/1215] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:00 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:02.590132 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-095a9e28-b824-4ed1-9b0d-df3134edc5cf req-cb63b43e-59f5-4422-ab53-b1d06db71f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc20f9c-35e3-4586-a419-82ed45c19481", "tag": "decc0218-8c0d-4f69-a8f7-06f0367b750c"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:23:02.600019 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-095a9e28-b824-4ed1-9b0d-df3134edc5cf req-cb63b43e-59f5-4422-ab53-b1d06db71f31 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:02.600472 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-095a9e28-b824-4ed1-9b0d-df3134edc5cf req-cb63b43e-59f5-4422-ab53-b1d06db71f31 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:02.600898 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-095a9e28-b824-4ed1-9b0d-df3134edc5cf req-cb63b43e-59f5-4422-ab53-b1d06db71f31 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:02.614959 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-095a9e28-b824-4ed1-9b0d-df3134edc5cf req-cb63b43e-59f5-4422-ab53-b1d06db71f31 service nova] Creating event network-changed:decc0218-8c0d-4f69-a8f7-06f0367b750c for instance 7cc20f9c-35e3-4586-a419-82ed45c19481 on hv-cinder-81571 Aug 30 01:23:02.620833 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-095a9e28-b824-4ed1-9b0d-df3134edc5cf req-cb63b43e-59f5-4422-ab53-b1d06db71f31 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034507 Aug 30 01:23:02.621472 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 588/1216] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:23:21.110630 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-efbdd8b7-4ad4-4891-8c6d-c6e735f2cb19 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:21.111181 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:21.111552 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-efbdd8b7-4ad4-4891-8c6d-c6e735f2cb19 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:21.111655 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:21.113963 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:21.114625 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=78 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:23:21.116022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-ee95168f-a772-4eb4-8923-817469b37002 req-92122f1b-34f9-456e-a827-14c501a04197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e28fa016-241d-473f-9697-13ab6e06fa91", "tag": "c4e6504b-45ee-4446-8a10-2c25ab5d86a4"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:23:21.119610 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-efbdd8b7-4ad4-4891-8c6d-c6e735f2cb19 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:21.124693 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-efbdd8b7-4ad4-4891-8c6d-c6e735f2cb19 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:21.124693 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-efbdd8b7-4ad4-4891-8c6d-c6e735f2cb19 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:21.124693 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-efbdd8b7-4ad4-4891-8c6d-c6e735f2cb19 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:21.124693 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-efbdd8b7-4ad4-4891-8c6d-c6e735f2cb19 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:21.125135 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-efbdd8b7-4ad4-4891-8c6d-c6e735f2cb19 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:21.127416 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ee95168f-a772-4eb4-8923-817469b37002 req-92122f1b-34f9-456e-a827-14c501a04197 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:21.128160 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ee95168f-a772-4eb4-8923-817469b37002 req-92122f1b-34f9-456e-a827-14c501a04197 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:21.128596 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-ee95168f-a772-4eb4-8923-817469b37002 req-92122f1b-34f9-456e-a827-14c501a04197 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:21.140946 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-ee95168f-a772-4eb4-8923-817469b37002 req-92122f1b-34f9-456e-a827-14c501a04197 service nova] Creating event network-changed:c4e6504b-45ee-4446-8a10-2c25ab5d86a4 for instance e28fa016-241d-473f-9697-13ab6e06fa91 on hv-cinder-81571 Aug 30 01:23:21.147266 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-ee95168f-a772-4eb4-8923-817469b37002 req-92122f1b-34f9-456e-a827-14c501a04197 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037275 Aug 30 01:23:21.147843 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 589/1217] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:23:21.153190 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-efbdd8b7-4ad4-4891-8c6d-c6e735f2cb19 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Going to try to terminate instance {{(pid=121233) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:23:21.509093 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-efbdd8b7-4ad4-4891-8c6d-c6e735f2cb19 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 204 len: 0 microversion: 2.1 time: 0.402805 Aug 30 01:23:21.509738 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 629/1218] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:23:21 2022] DELETE /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 01:23:21.519580 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-21c086ce-25d2-4d43-a046-0a464910cfcd tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:21.520489 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-21c086ce-25d2-4d43-a046-0a464910cfcd tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:21.522762 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 01:23:21.522923 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Tue Aug 30 01:23:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 (ip 10.222.0.52) !!! Aug 30 01:23:21.540250 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21c086ce-25d2-4d43-a046-0a464910cfcd tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:21.540727 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21c086ce-25d2-4d43-a046-0a464910cfcd tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:21.541396 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21c086ce-25d2-4d43-a046-0a464910cfcd tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:21.542184 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21c086ce-25d2-4d43-a046-0a464910cfcd tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:21.542639 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21c086ce-25d2-4d43-a046-0a464910cfcd tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:21.543067 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-21c086ce-25d2-4d43-a046-0a464910cfcd tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:21.702341 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-21c086ce-25d2-4d43-a046-0a464910cfcd tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:21.710296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-21c086ce-25d2-4d43-a046-0a464910cfcd tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1568 microversion: 2.1 time: 0.195812 Aug 30 01:23:21.711077 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 590/1219] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:21 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:22.733499 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-61bc0c75-00a0-46cb-acef-e3f38b237be0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:22.734147 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-61bc0c75-00a0-46cb-acef-e3f38b237be0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:22.740774 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-61bc0c75-00a0-46cb-acef-e3f38b237be0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:22.741257 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-61bc0c75-00a0-46cb-acef-e3f38b237be0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:22.741696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-61bc0c75-00a0-46cb-acef-e3f38b237be0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:22.742418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-61bc0c75-00a0-46cb-acef-e3f38b237be0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:22.742873 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-61bc0c75-00a0-46cb-acef-e3f38b237be0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:22.743300 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-61bc0c75-00a0-46cb-acef-e3f38b237be0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:22.881176 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-61bc0c75-00a0-46cb-acef-e3f38b237be0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:22.890446 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-61bc0c75-00a0-46cb-acef-e3f38b237be0 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1568 microversion: 2.1 time: 0.161820 Aug 30 01:23:22.891052 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 630/1220] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:22 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:23.912728 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ac6efe06-02f9-4342-b1e0-6f2cdd2db008 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:23.913517 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ac6efe06-02f9-4342-b1e0-6f2cdd2db008 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:23.920927 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac6efe06-02f9-4342-b1e0-6f2cdd2db008 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:23.921421 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac6efe06-02f9-4342-b1e0-6f2cdd2db008 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:23.921891 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac6efe06-02f9-4342-b1e0-6f2cdd2db008 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:23.922600 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac6efe06-02f9-4342-b1e0-6f2cdd2db008 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:23.923106 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac6efe06-02f9-4342-b1e0-6f2cdd2db008 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:23.923656 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ac6efe06-02f9-4342-b1e0-6f2cdd2db008 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:24.134808 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-8b048d88-7cea-4147-bc0e-48ce32da614c req-a6e737c9-554b-448e-a24f-402a17870126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e28fa016-241d-473f-9697-13ab6e06fa91", "name": "network-vif-deleted", "tag": "c4e6504b-45ee-4446-8a10-2c25ab5d86a4"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:23:24.141856 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ac6efe06-02f9-4342-b1e0-6f2cdd2db008 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:24.146045 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-8b048d88-7cea-4147-bc0e-48ce32da614c req-a6e737c9-554b-448e-a24f-402a17870126 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:24.150244 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-8b048d88-7cea-4147-bc0e-48ce32da614c req-a6e737c9-554b-448e-a24f-402a17870126 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:24.150244 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-8b048d88-7cea-4147-bc0e-48ce32da614c req-a6e737c9-554b-448e-a24f-402a17870126 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:24.159843 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-8b048d88-7cea-4147-bc0e-48ce32da614c req-a6e737c9-554b-448e-a24f-402a17870126 service nova] Creating event network-vif-deleted:c4e6504b-45ee-4446-8a10-2c25ab5d86a4 for instance e28fa016-241d-473f-9697-13ab6e06fa91 on hv-cinder-81571 Aug 30 01:23:24.160065 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ac6efe06-02f9-4342-b1e0-6f2cdd2db008 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1449 microversion: 2.1 time: 0.251435 Aug 30 01:23:24.160818 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 591/1221] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:23 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1449 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:24.165185 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-8b048d88-7cea-4147-bc0e-48ce32da614c req-a6e737c9-554b-448e-a24f-402a17870126 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034171 Aug 30 01:23:24.166194 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 631/1222] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:23:25.182506 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-66ca7e04-0542-4503-a912-a670bb3439da tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:25.183129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-66ca7e04-0542-4503-a912-a670bb3439da tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:25.190348 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-66ca7e04-0542-4503-a912-a670bb3439da tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:25.191076 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-66ca7e04-0542-4503-a912-a670bb3439da tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:25.191394 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-66ca7e04-0542-4503-a912-a670bb3439da tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:25.192117 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-66ca7e04-0542-4503-a912-a670bb3439da tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:25.192578 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-66ca7e04-0542-4503-a912-a670bb3439da tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:25.193010 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-66ca7e04-0542-4503-a912-a670bb3439da tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:25.257863 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-66ca7e04-0542-4503-a912-a670bb3439da tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9352fbf7d98b40d7954ce1ff3d968761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bd03ea50c4553b9b98b61a4d835dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:23:25.266268 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-66ca7e04-0542-4503-a912-a670bb3439da tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 200 len: 1219 microversion: 2.1 time: 0.087784 Aug 30 01:23:25.267067 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 592/1223] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:25 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:23:26.288644 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-59789a89-de17-4333-80fe-914ae806bf7c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:26.289335 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-59789a89-de17-4333-80fe-914ae806bf7c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] [instance: e28fa016-241d-473f-9697-13ab6e06fa91] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:23:26.295694 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-59789a89-de17-4333-80fe-914ae806bf7c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:26.296170 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-59789a89-de17-4333-80fe-914ae806bf7c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:26.296600 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-59789a89-de17-4333-80fe-914ae806bf7c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:26.297282 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-59789a89-de17-4333-80fe-914ae806bf7c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:23:26.297752 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-59789a89-de17-4333-80fe-914ae806bf7c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:23:26.298178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-59789a89-de17-4333-80fe-914ae806bf7c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:23:26.312259 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-59789a89-de17-4333-80fe-914ae806bf7c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] HTTP exception thrown: Instance e28fa016-241d-473f-9697-13ab6e06fa91 could not be found. Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-59789a89-de17-4333-80fe-914ae806bf7c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Request method failure captured: Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 HTTP/1.1 Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWVHskm6E3ATNbxBxVJxq-Ngiq5w_l5-ffjCjuB3nIcZPRm9Sl98CYy74MhmJns9RbN9zCXMBfD4XTbdyRwPny022BSFv4ndU8D2XI0lqs46AlGMuPrXKR04NUS-Zv1Kl8B4PW1XiyCHRQMxiQTj1KJrlzatKB3haIuHZOxb7oPaNPw Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: ba3bd03ea50c4553b9b98b61a4d835dd Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-TestShelveInstance-159913963 Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:23:26.313903 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:23:26.315642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba3bd03ea50c4553b9b98b61a4d835dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba3bd03ea50c4553b9b98b61a4d835dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba3bd03ea50c4553b9b98b61a4d835dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba3bd03ea50c4553b9b98b61a4d835dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:23:26.315642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-TestShelveInstance-159913963 Aug 30 01:23:26.315642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: ba3bd03ea50c4553b9b98b61a4d835dd Aug 30 01:23:26.315642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-TestShelveInstance-159913963 Aug 30 01:23:26.315642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-TestShelveInstance-159913963-project Aug 30 01:23:26.315642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:23:26.315642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:23:26.315642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: 9352fbf7d98b40d7954ce1ff3d968761 Aug 30 01:23:26.315642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-TestShelveInstance-159913963-project Aug 30 01:23:26.315642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:23:26.315642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance e28fa016-241d-473f-9697-13ab6e06fa91 could not be found. Aug 30 01:23:26.315642 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': 'e28fa016-241d-473f-9697-13ab6e06fa91'} Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e28fa016-241d-473f-9697-13ab6e06fa91 could not be found. Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:23:26.316629 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e28fa016-241d-473f-9697-13ab6e06fa91 could not be found. Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e28fa016-241d-473f-9697-13ab6e06fa91 could not be found. Aug 30 01:23:26.318418 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:23:26.319965 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-59789a89-de17-4333-80fe-914ae806bf7c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Returning 404 to user: Instance e28fa016-241d-473f-9697-13ab6e06fa91 could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:23:26.319965 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-59789a89-de17-4333-80fe-914ae806bf7c tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91" status: 404 len: 111 microversion: 2.1 time: 0.031397 Aug 30 01:23:26.319965 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 632/1224] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:23:26 2022] GET /compute/v2.1/servers/e28fa016-241d-473f-9697-13ab6e06fa91 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:23:26.554019 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-094f23a8-f8b8-4b94-ad09-6724754e3112 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] Calling method '.version_select at 0x7fd71cfbc430>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:23:26.637518 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-094f23a8-f8b8-4b94-ad09-6724754e3112 tempest-TestShelveInstance-159913963 tempest-TestShelveInstance-159913963-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1963560351" status: 202 len: 0 microversion: 2.1 time: 0.087282 Aug 30 01:23:26.638224 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 593/1225] 10.222.0.52 () {58 vars in 1254 bytes} [Tue Aug 30 01:23:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1963560351 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:24:50.381304 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 01:24:50.381907 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Tue Aug 30 01:24:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Aug 30 01:24:50.382450 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:50.383225 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:50.387343 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-212770267", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-399237452", "security_groups": [{"name": "tempest-secgroup-smoke-1826305638"}], "block_device_mapping_v2": [{"uuid": "ab506ed8-d1ab-49fd-8a28-116ac7fdeeac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8c6152a9-22c5-47c3-b922-7c52df366312"}]}} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:50.539030 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.network.neutron [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] validate_networks() for [('8c6152a9-22c5-47c3-b922-7c52df366312', None, None, None, None, None)] {{(pid=121233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:24:51.019107 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Flavor limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:24:51.020147 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Image limits 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:24:51.020604 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Flavor pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:24:51.021010 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Image pref 0:0:0 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:24:51.021415 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.virt.hardware [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:24:51.030246 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:51.030696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:51.031123 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:51.031830 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:51.032280 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:51.032692 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:51.042773 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0814acf-1070-4da9-bcdd-ccd86e22137d] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 01:24:51.053571 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Getting quotas for project 3068817b4ca34beca8bd4da5409e58ef. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:24:51.057583 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.quota [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Getting quotas for user b5b9eb7e61704da582a326e48e3a5170 and project 3068817b4ca34beca8bd4da5409e58ef. Resources: {'ram', 'instances', 'cores'} {{(pid=121233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:24:51.115738 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Going to run 1 instances... {{(pid=121233) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:24:51.117911 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ab506ed8-d1ab-49fd-8a28-116ac7fdeeac',volume_size=None,volume_type=None)] {{(pid=121233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:24:51.436397 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-e0d05be5-739f-4193-b8ce-deb0368edc78 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.058068 Aug 30 01:24:51.437140 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 633/1226] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 30 01:24:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:24:51.445581 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b626c90-6a33-4c30-a63e-c1ae636e04f2] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 01:24:51.446190 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=20 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:51.446884 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:24:51.451098 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a97a7145-a1d7-4ce3-b3bb-13b61ac180e7 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:51.451715 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a97a7145-a1d7-4ce3-b3bb-13b61ac180e7 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:51.506840 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a97a7145-a1d7-4ce3-b3bb-13b61ac180e7 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:51.515666 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a97a7145-a1d7-4ce3-b3bb-13b61ac180e7 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1093 microversion: 2.1 time: 0.071720 Aug 30 01:24:51.516445 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 594/1227] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:51 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:24:52.537283 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-031355ef-fae9-48f1-a05b-0762a3972c07 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:52.537951 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-031355ef-fae9-48f1-a05b-0762a3972c07 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:52.546119 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-031355ef-fae9-48f1-a05b-0762a3972c07 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:52.546607 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-031355ef-fae9-48f1-a05b-0762a3972c07 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:52.547045 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-031355ef-fae9-48f1-a05b-0762a3972c07 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:52.547743 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-031355ef-fae9-48f1-a05b-0762a3972c07 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:52.548253 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-031355ef-fae9-48f1-a05b-0762a3972c07 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:52.548700 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-031355ef-fae9-48f1-a05b-0762a3972c07 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:52.554952 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0814acf-1070-4da9-bcdd-ccd86e22137d] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 52772. Aug 30 01:24:52.612649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-031355ef-fae9-48f1-a05b-0762a3972c07 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:52.621475 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-031355ef-fae9-48f1-a05b-0762a3972c07 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1143 microversion: 2.1 time: 0.088951 Aug 30 01:24:52.622069 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 634/1228] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:52 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:53.642326 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-569a5b61-98d0-4fd8-98e1-0763c2bbea36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:53.643031 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-569a5b61-98d0-4fd8-98e1-0763c2bbea36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:53.651098 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-569a5b61-98d0-4fd8-98e1-0763c2bbea36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:53.653619 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-569a5b61-98d0-4fd8-98e1-0763c2bbea36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:53.653619 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-569a5b61-98d0-4fd8-98e1-0763c2bbea36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:53.653619 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-569a5b61-98d0-4fd8-98e1-0763c2bbea36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:53.653619 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-569a5b61-98d0-4fd8-98e1-0763c2bbea36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:53.654060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-569a5b61-98d0-4fd8-98e1-0763c2bbea36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:53.660047 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b626c90-6a33-4c30-a63e-c1ae636e04f2] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 52776. Aug 30 01:24:53.720606 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-569a5b61-98d0-4fd8-98e1-0763c2bbea36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:53.728708 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-569a5b61-98d0-4fd8-98e1-0763c2bbea36 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1191 microversion: 2.1 time: 0.090340 Aug 30 01:24:53.729281 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 595/1229] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:53 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:54.752731 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-5c050e5c-fe1a-475a-8ae5-ac0fcf34ae38 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:54.753508 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-5c050e5c-fe1a-475a-8ae5-ac0fcf34ae38 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:54.761951 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c050e5c-fe1a-475a-8ae5-ac0fcf34ae38 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:54.762446 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c050e5c-fe1a-475a-8ae5-ac0fcf34ae38 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:54.762899 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c050e5c-fe1a-475a-8ae5-ac0fcf34ae38 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:54.764042 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c050e5c-fe1a-475a-8ae5-ac0fcf34ae38 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:54.764690 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c050e5c-fe1a-475a-8ae5-ac0fcf34ae38 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:54.765127 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-5c050e5c-fe1a-475a-8ae5-ac0fcf34ae38 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:54.909339 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-5c050e5c-fe1a-475a-8ae5-ac0fcf34ae38 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:54.918297 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-5c050e5c-fe1a-475a-8ae5-ac0fcf34ae38 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1277 microversion: 2.1 time: 0.169295 Aug 30 01:24:54.919281 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 635/1230] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:54 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:55.525217 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-d0046986-12fd-42b8-ab24-204269e955f5 req-3d1f2443-25aa-4e6f-b093-a1aa2fc40cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c96b9ac-8706-42aa-ba6a-ef444bf4cbac", "tag": "6f17c2c9-ce9d-4f6e-81e8-df6bd994b754"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:24:55.535867 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d0046986-12fd-42b8-ab24-204269e955f5 req-3d1f2443-25aa-4e6f-b093-a1aa2fc40cf3 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:55.536950 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d0046986-12fd-42b8-ab24-204269e955f5 req-3d1f2443-25aa-4e6f-b093-a1aa2fc40cf3 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:55.537394 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d0046986-12fd-42b8-ab24-204269e955f5 req-3d1f2443-25aa-4e6f-b093-a1aa2fc40cf3 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:55.548941 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-d0046986-12fd-42b8-ab24-204269e955f5 req-3d1f2443-25aa-4e6f-b093-a1aa2fc40cf3 service nova] Creating event network-changed:6f17c2c9-ce9d-4f6e-81e8-df6bd994b754 for instance 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac on hv-cinder-81571 Aug 30 01:24:55.555055 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-d0046986-12fd-42b8-ab24-204269e955f5 req-3d1f2443-25aa-4e6f-b093-a1aa2fc40cf3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032707 Aug 30 01:24:55.555475 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 596/1231] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:24:55.943022 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-724b024c-cbbf-44f9-8a35-3bb483496f06 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:55.943681 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-724b024c-cbbf-44f9-8a35-3bb483496f06 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:55.950724 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-724b024c-cbbf-44f9-8a35-3bb483496f06 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:55.951223 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-724b024c-cbbf-44f9-8a35-3bb483496f06 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:55.951655 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-724b024c-cbbf-44f9-8a35-3bb483496f06 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:55.952342 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-724b024c-cbbf-44f9-8a35-3bb483496f06 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:55.952815 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-724b024c-cbbf-44f9-8a35-3bb483496f06 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:55.953235 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-724b024c-cbbf-44f9-8a35-3bb483496f06 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:56.089568 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-724b024c-cbbf-44f9-8a35-3bb483496f06 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:56.097426 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-724b024c-cbbf-44f9-8a35-3bb483496f06 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1265 microversion: 2.1 time: 0.158463 Aug 30 01:24:56.098038 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 636/1232] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:55 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:24:57.120283 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-54a80df8-7d1b-40f8-b97d-34609cc6d224 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:57.121037 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-54a80df8-7d1b-40f8-b97d-34609cc6d224 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:57.127151 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54a80df8-7d1b-40f8-b97d-34609cc6d224 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:57.127625 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54a80df8-7d1b-40f8-b97d-34609cc6d224 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:57.128060 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54a80df8-7d1b-40f8-b97d-34609cc6d224 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:57.128746 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54a80df8-7d1b-40f8-b97d-34609cc6d224 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:57.129199 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54a80df8-7d1b-40f8-b97d-34609cc6d224 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:57.129620 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54a80df8-7d1b-40f8-b97d-34609cc6d224 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:57.266791 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-54a80df8-7d1b-40f8-b97d-34609cc6d224 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:57.275133 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-54a80df8-7d1b-40f8-b97d-34609cc6d224 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1265 microversion: 2.1 time: 0.159590 Aug 30 01:24:57.275709 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 597/1233] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:57 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:58.295886 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-1698362d-7f73-4638-835d-de0f449b354d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:58.296526 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-1698362d-7f73-4638-835d-de0f449b354d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:58.303062 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1698362d-7f73-4638-835d-de0f449b354d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:58.303549 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1698362d-7f73-4638-835d-de0f449b354d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:58.304082 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1698362d-7f73-4638-835d-de0f449b354d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:58.304801 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1698362d-7f73-4638-835d-de0f449b354d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:58.305257 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1698362d-7f73-4638-835d-de0f449b354d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:58.305684 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1698362d-7f73-4638-835d-de0f449b354d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:58.442368 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-1698362d-7f73-4638-835d-de0f449b354d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:58.450988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-1698362d-7f73-4638-835d-de0f449b354d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1265 microversion: 2.1 time: 0.159027 Aug 30 01:24:58.451552 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 637/1234] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:58 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:24:59.472253 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cdbf9324-0fc4-4079-b04f-07079dc406dc tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:24:59.472878 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cdbf9324-0fc4-4079-b04f-07079dc406dc tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:24:59.480404 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cdbf9324-0fc4-4079-b04f-07079dc406dc tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:59.480960 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cdbf9324-0fc4-4079-b04f-07079dc406dc tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:59.481408 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cdbf9324-0fc4-4079-b04f-07079dc406dc tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:59.482177 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cdbf9324-0fc4-4079-b04f-07079dc406dc tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:24:59.482644 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cdbf9324-0fc4-4079-b04f-07079dc406dc tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:24:59.483078 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cdbf9324-0fc4-4079-b04f-07079dc406dc tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:24:59.696453 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cdbf9324-0fc4-4079-b04f-07079dc406dc tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:24:59.704341 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cdbf9324-0fc4-4079-b04f-07079dc406dc tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1265 microversion: 2.1 time: 0.236026 Aug 30 01:24:59.705137 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 598/1235] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:24:59 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:00.725048 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-1388b43a-56f2-4522-952d-438f4ce25348 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:00.725627 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-1388b43a-56f2-4522-952d-438f4ce25348 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:00.733011 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1388b43a-56f2-4522-952d-438f4ce25348 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:00.733499 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1388b43a-56f2-4522-952d-438f4ce25348 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:00.733965 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1388b43a-56f2-4522-952d-438f4ce25348 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:00.734696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1388b43a-56f2-4522-952d-438f4ce25348 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:00.735332 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1388b43a-56f2-4522-952d-438f4ce25348 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:00.735764 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-1388b43a-56f2-4522-952d-438f4ce25348 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:00.875717 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-1388b43a-56f2-4522-952d-438f4ce25348 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:00.884277 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-1388b43a-56f2-4522-952d-438f4ce25348 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1265 microversion: 2.1 time: 0.163280 Aug 30 01:25:00.884850 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 638/1236] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:00 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:01.906187 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1b43e237-a3cd-4dfb-ae7f-7fdf965d8fd7 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:01.906783 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1b43e237-a3cd-4dfb-ae7f-7fdf965d8fd7 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:01.909237 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:01.915387 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b43e237-a3cd-4dfb-ae7f-7fdf965d8fd7 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:01.916032 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b43e237-a3cd-4dfb-ae7f-7fdf965d8fd7 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:01.916380 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b43e237-a3cd-4dfb-ae7f-7fdf965d8fd7 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:01.917078 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b43e237-a3cd-4dfb-ae7f-7fdf965d8fd7 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:01.917534 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b43e237-a3cd-4dfb-ae7f-7fdf965d8fd7 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:01.917991 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b43e237-a3cd-4dfb-ae7f-7fdf965d8fd7 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:02.056299 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1b43e237-a3cd-4dfb-ae7f-7fdf965d8fd7 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:02.063978 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1b43e237-a3cd-4dfb-ae7f-7fdf965d8fd7 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1265 microversion: 2.1 time: 0.162009 Aug 30 01:25:02.064553 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 599/1237] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:01 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:03.085549 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-95a487a7-c864-4175-869f-ac3631cb100c tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:03.086200 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-95a487a7-c864-4175-869f-ac3631cb100c tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:03.088865 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=2 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:03.089665 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell0:SELECT=6 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:25:03.096019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95a487a7-c864-4175-869f-ac3631cb100c tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:03.096552 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95a487a7-c864-4175-869f-ac3631cb100c tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:03.097003 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95a487a7-c864-4175-869f-ac3631cb100c tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:03.097776 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95a487a7-c864-4175-869f-ac3631cb100c tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:03.098269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95a487a7-c864-4175-869f-ac3631cb100c tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:03.098698 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-95a487a7-c864-4175-869f-ac3631cb100c tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:03.242614 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-95a487a7-c864-4175-869f-ac3631cb100c tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:03.252034 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-95a487a7-c864-4175-869f-ac3631cb100c tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1265 microversion: 2.1 time: 0.171350 Aug 30 01:25:03.252608 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 639/1238] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:03 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:04.273424 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-69a8c872-ff1d-4b04-ba58-38f7878a50bd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:04.274079 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-69a8c872-ff1d-4b04-ba58-38f7878a50bd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:04.281267 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69a8c872-ff1d-4b04-ba58-38f7878a50bd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:04.288251 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69a8c872-ff1d-4b04-ba58-38f7878a50bd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:04.288251 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69a8c872-ff1d-4b04-ba58-38f7878a50bd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:04.288251 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69a8c872-ff1d-4b04-ba58-38f7878a50bd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:04.288251 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69a8c872-ff1d-4b04-ba58-38f7878a50bd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:04.288690 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69a8c872-ff1d-4b04-ba58-38f7878a50bd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:04.420117 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-69a8c872-ff1d-4b04-ba58-38f7878a50bd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:04.423084 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-69a8c872-ff1d-4b04-ba58-38f7878a50bd tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1265 microversion: 2.1 time: 0.153598 Aug 30 01:25:04.423677 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 600/1239] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:04 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:05.444375 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d09d9bce-5832-4762-b22f-db5617ada5d1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:05.445040 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d09d9bce-5832-4762-b22f-db5617ada5d1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:05.452326 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d09d9bce-5832-4762-b22f-db5617ada5d1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:05.452810 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d09d9bce-5832-4762-b22f-db5617ada5d1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:05.453253 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d09d9bce-5832-4762-b22f-db5617ada5d1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:05.453982 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d09d9bce-5832-4762-b22f-db5617ada5d1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:05.454443 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d09d9bce-5832-4762-b22f-db5617ada5d1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:05.454872 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d09d9bce-5832-4762-b22f-db5617ada5d1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:05.588467 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d09d9bce-5832-4762-b22f-db5617ada5d1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:05.596422 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d09d9bce-5832-4762-b22f-db5617ada5d1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1265 microversion: 2.1 time: 0.155990 Aug 30 01:25:05.596996 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 640/1240] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:05 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:06.617120 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-68886c49-7223-4c32-80b9-8f84ab3c3c68 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:06.617749 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-68886c49-7223-4c32-80b9-8f84ab3c3c68 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:06.624318 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68886c49-7223-4c32-80b9-8f84ab3c3c68 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:06.624822 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68886c49-7223-4c32-80b9-8f84ab3c3c68 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:06.625249 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68886c49-7223-4c32-80b9-8f84ab3c3c68 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:06.625983 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68886c49-7223-4c32-80b9-8f84ab3c3c68 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:06.626439 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68886c49-7223-4c32-80b9-8f84ab3c3c68 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:06.626867 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-68886c49-7223-4c32-80b9-8f84ab3c3c68 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:06.760957 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-68886c49-7223-4c32-80b9-8f84ab3c3c68 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:06.768675 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-68886c49-7223-4c32-80b9-8f84ab3c3c68 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1265 microversion: 2.1 time: 0.155538 Aug 30 01:25:06.769242 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 601/1241] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:06 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:07.333154 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-784891e4-b850-4113-8c5d-31133ba9f3c0 req-ef0b47ef-de36-4f36-b27c-e3ae41faa38d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c96b9ac-8706-42aa-ba6a-ef444bf4cbac", "name": "network-vif-plugged", "status": "completed", "tag": "6f17c2c9-ce9d-4f6e-81e8-df6bd994b754"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:25:07.343781 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-784891e4-b850-4113-8c5d-31133ba9f3c0 req-ef0b47ef-de36-4f36-b27c-e3ae41faa38d service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:07.344298 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-784891e4-b850-4113-8c5d-31133ba9f3c0 req-ef0b47ef-de36-4f36-b27c-e3ae41faa38d service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:07.344740 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-784891e4-b850-4113-8c5d-31133ba9f3c0 req-ef0b47ef-de36-4f36-b27c-e3ae41faa38d service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:07.355951 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-784891e4-b850-4113-8c5d-31133ba9f3c0 req-ef0b47ef-de36-4f36-b27c-e3ae41faa38d service nova] Creating event network-vif-plugged:6f17c2c9-ce9d-4f6e-81e8-df6bd994b754 for instance 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac on hv-cinder-81571 Aug 30 01:25:07.361136 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-784891e4-b850-4113-8c5d-31133ba9f3c0 req-ef0b47ef-de36-4f36-b27c-e3ae41faa38d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031799 Aug 30 01:25:07.361842 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 641/1242] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:25:07.791210 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-483c1071-c483-4c90-9075-ce891a444c75 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:07.792752 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-483c1071-c483-4c90-9075-ce891a444c75 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:07.799294 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-483c1071-c483-4c90-9075-ce891a444c75 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:07.799777 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-483c1071-c483-4c90-9075-ce891a444c75 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:07.800212 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-483c1071-c483-4c90-9075-ce891a444c75 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:07.800922 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-483c1071-c483-4c90-9075-ce891a444c75 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:07.801369 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-483c1071-c483-4c90-9075-ce891a444c75 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:07.801820 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-483c1071-c483-4c90-9075-ce891a444c75 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:07.936088 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-483c1071-c483-4c90-9075-ce891a444c75 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:07.944194 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-483c1071-c483-4c90-9075-ce891a444c75 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1265 microversion: 2.1 time: 0.157422 Aug 30 01:25:07.944793 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 602/1243] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:07 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:08.966289 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c44bb085-337c-4c88-8543-acaaf0fbc01a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:08.966997 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-c44bb085-337c-4c88-8543-acaaf0fbc01a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:08.973372 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c44bb085-337c-4c88-8543-acaaf0fbc01a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:08.973884 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c44bb085-337c-4c88-8543-acaaf0fbc01a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:08.974320 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c44bb085-337c-4c88-8543-acaaf0fbc01a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:08.975019 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c44bb085-337c-4c88-8543-acaaf0fbc01a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:08.975465 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c44bb085-337c-4c88-8543-acaaf0fbc01a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:08.975885 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-c44bb085-337c-4c88-8543-acaaf0fbc01a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:09.111729 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-c44bb085-337c-4c88-8543-acaaf0fbc01a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:09.119747 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c44bb085-337c-4c88-8543-acaaf0fbc01a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1265 microversion: 2.1 time: 0.158918 Aug 30 01:25:09.120354 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 642/1244] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:08 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:10.140174 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-55e896a1-df3c-483e-8d4f-5452b6cee930 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:10.140785 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-55e896a1-df3c-483e-8d4f-5452b6cee930 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:10.147211 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55e896a1-df3c-483e-8d4f-5452b6cee930 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:10.147697 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55e896a1-df3c-483e-8d4f-5452b6cee930 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:10.148125 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55e896a1-df3c-483e-8d4f-5452b6cee930 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:10.148813 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55e896a1-df3c-483e-8d4f-5452b6cee930 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:10.149369 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55e896a1-df3c-483e-8d4f-5452b6cee930 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:10.149821 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55e896a1-df3c-483e-8d4f-5452b6cee930 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:10.290033 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-55e896a1-df3c-483e-8d4f-5452b6cee930 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:10.298665 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-55e896a1-df3c-483e-8d4f-5452b6cee930 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1451 microversion: 2.1 time: 0.162758 Aug 30 01:25:10.299244 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 603/1245] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:10 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:10.318367 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-d05028b0-b108-495b-ab94-def34cb1bbc9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:25:10.319012 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-d05028b0-b108-495b-ab94-def34cb1bbc9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:25:10.329353 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d05028b0-b108-495b-ab94-def34cb1bbc9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:10.329869 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d05028b0-b108-495b-ab94-def34cb1bbc9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:10.330310 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d05028b0-b108-495b-ab94-def34cb1bbc9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:10.331017 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d05028b0-b108-495b-ab94-def34cb1bbc9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:10.331475 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d05028b0-b108-495b-ab94-def34cb1bbc9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:10.331904 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-d05028b0-b108-495b-ab94-def34cb1bbc9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:10.464333 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-d05028b0-b108-495b-ab94-def34cb1bbc9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:25:10.473615 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-d05028b0-b108-495b-ab94-def34cb1bbc9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1451 microversion: 2.1 time: 0.158964 Aug 30 01:25:10.474231 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 643/1246] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:25:10 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:25:12.728044 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-b1c58324-200e-4280-be4d-265e0c4598b6 req-ab55ad0f-a8ad-47fb-8958-cd1ed92bece8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c96b9ac-8706-42aa-ba6a-ef444bf4cbac", "tag": "6f17c2c9-ce9d-4f6e-81e8-df6bd994b754"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:25:12.739164 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-b1c58324-200e-4280-be4d-265e0c4598b6 req-ab55ad0f-a8ad-47fb-8958-cd1ed92bece8 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:25:12.739636 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-b1c58324-200e-4280-be4d-265e0c4598b6 req-ab55ad0f-a8ad-47fb-8958-cd1ed92bece8 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:25:12.740064 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-b1c58324-200e-4280-be4d-265e0c4598b6 req-ab55ad0f-a8ad-47fb-8958-cd1ed92bece8 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:25:12.752545 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-b1c58324-200e-4280-be4d-265e0c4598b6 req-ab55ad0f-a8ad-47fb-8958-cd1ed92bece8 service nova] Creating event network-changed:6f17c2c9-ce9d-4f6e-81e8-df6bd994b754 for instance 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac on hv-cinder-81571 Aug 30 01:25:12.757662 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-b1c58324-200e-4280-be4d-265e0c4598b6 req-ab55ad0f-a8ad-47fb-8958-cd1ed92bece8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155351 Aug 30 01:25:12.758341 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 604/1247] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:26:42.749701 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:42.751178 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG dbcounter [-] [121233] Writing DB stats nova_cell1:SELECT=58 {{(pid=121233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:42.753016 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=24 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:42.753866 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=52 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:26:42.754739 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 01:26:42.754871 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Tue Aug 30 01:26:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Aug 30 01:26:42.756158 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 01:26:42.756272 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Tue Aug 30 01:26:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Aug 30 01:26:42.756584 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-bcdda2a4-e77e-42c3-8051-b48b420cc9e9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:42.759990 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-bcdda2a4-e77e-42c3-8051-b48b420cc9e9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:42.762637 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-da4d4c5c-6c08-4f52-8561-f4177cba4bf2 req-8955f368-c548-4251-9e03-91973c8bc48c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c96b9ac-8706-42aa-ba6a-ef444bf4cbac", "tag": "6f17c2c9-ce9d-4f6e-81e8-df6bd994b754"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:26:42.766746 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bcdda2a4-e77e-42c3-8051-b48b420cc9e9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:42.768363 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bcdda2a4-e77e-42c3-8051-b48b420cc9e9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:42.768363 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bcdda2a4-e77e-42c3-8051-b48b420cc9e9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:42.769060 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bcdda2a4-e77e-42c3-8051-b48b420cc9e9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:42.769536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bcdda2a4-e77e-42c3-8051-b48b420cc9e9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:42.770001 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-bcdda2a4-e77e-42c3-8051-b48b420cc9e9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:42.776604 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-da4d4c5c-6c08-4f52-8561-f4177cba4bf2 req-8955f368-c548-4251-9e03-91973c8bc48c service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:42.777096 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-da4d4c5c-6c08-4f52-8561-f4177cba4bf2 req-8955f368-c548-4251-9e03-91973c8bc48c service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:42.777535 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-da4d4c5c-6c08-4f52-8561-f4177cba4bf2 req-8955f368-c548-4251-9e03-91973c8bc48c service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:42.794737 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-da4d4c5c-6c08-4f52-8561-f4177cba4bf2 req-8955f368-c548-4251-9e03-91973c8bc48c service nova] Creating event network-changed:6f17c2c9-ce9d-4f6e-81e8-df6bd994b754 for instance 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac on hv-cinder-81571 Aug 30 01:26:42.800344 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-da4d4c5c-6c08-4f52-8561-f4177cba4bf2 req-8955f368-c548-4251-9e03-91973c8bc48c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049531 Aug 30 01:26:42.801182 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 605/1248] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:26:42.809547 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-bcdda2a4-e77e-42c3-8051-b48b420cc9e9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Going to try to terminate instance {{(pid=121233) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:26:43.138140 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-bcdda2a4-e77e-42c3-8051-b48b420cc9e9 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 204 len: 0 microversion: 2.1 time: 0.386152 Aug 30 01:26:43.138140 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 644/1249] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:26:42 2022] DELETE /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:26:43.144442 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ec203925-abb1-431e-bcbd-ee0fa2aec589 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:43.145157 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ec203925-abb1-431e-bcbd-ee0fa2aec589 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:43.152736 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec203925-abb1-431e-bcbd-ee0fa2aec589 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:43.153229 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec203925-abb1-431e-bcbd-ee0fa2aec589 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:43.153677 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec203925-abb1-431e-bcbd-ee0fa2aec589 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:43.154502 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec203925-abb1-431e-bcbd-ee0fa2aec589 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:43.154962 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec203925-abb1-431e-bcbd-ee0fa2aec589 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:43.155408 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec203925-abb1-431e-bcbd-ee0fa2aec589 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:43.341977 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ec203925-abb1-431e-bcbd-ee0fa2aec589 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:43.350133 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ec203925-abb1-431e-bcbd-ee0fa2aec589 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1576 microversion: 2.1 time: 0.210479 Aug 30 01:26:43.350808 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 606/1250] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:43 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:44.372696 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4275d1f7-503c-4cf0-83de-29bc6388709f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:44.373433 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4275d1f7-503c-4cf0-83de-29bc6388709f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:44.380236 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4275d1f7-503c-4cf0-83de-29bc6388709f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:44.380719 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4275d1f7-503c-4cf0-83de-29bc6388709f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:44.381159 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4275d1f7-503c-4cf0-83de-29bc6388709f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:44.381894 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4275d1f7-503c-4cf0-83de-29bc6388709f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:44.382365 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4275d1f7-503c-4cf0-83de-29bc6388709f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:44.382843 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4275d1f7-503c-4cf0-83de-29bc6388709f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:44.571052 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4275d1f7-503c-4cf0-83de-29bc6388709f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:44.578960 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4275d1f7-503c-4cf0-83de-29bc6388709f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1576 microversion: 2.1 time: 0.210524 Aug 30 01:26:44.579536 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 645/1251] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:44 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:45.600587 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1b7eadf8-7f89-4c80-9d88-4c03d0dce111 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:45.602576 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1b7eadf8-7f89-4c80-9d88-4c03d0dce111 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:45.608535 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b7eadf8-7f89-4c80-9d88-4c03d0dce111 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:45.609800 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b7eadf8-7f89-4c80-9d88-4c03d0dce111 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:45.609800 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b7eadf8-7f89-4c80-9d88-4c03d0dce111 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:45.610181 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b7eadf8-7f89-4c80-9d88-4c03d0dce111 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:45.610572 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b7eadf8-7f89-4c80-9d88-4c03d0dce111 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:45.610994 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b7eadf8-7f89-4c80-9d88-4c03d0dce111 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:45.721140 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1b7eadf8-7f89-4c80-9d88-4c03d0dce111 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:45.729835 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1b7eadf8-7f89-4c80-9d88-4c03d0dce111 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1389 microversion: 2.1 time: 0.133036 Aug 30 01:26:45.730643 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 607/1252] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:45 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1389 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:45.761697 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-19d5dd5a-4985-4537-86b3-ff0e4b35873f req-ad7761ef-b219-49af-92c4-52346eb0e443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c96b9ac-8706-42aa-ba6a-ef444bf4cbac", "name": "network-vif-deleted", "tag": "6f17c2c9-ce9d-4f6e-81e8-df6bd994b754"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:26:45.771939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-19d5dd5a-4985-4537-86b3-ff0e4b35873f req-ad7761ef-b219-49af-92c4-52346eb0e443 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:45.772379 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-19d5dd5a-4985-4537-86b3-ff0e4b35873f req-ad7761ef-b219-49af-92c4-52346eb0e443 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:45.772809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-19d5dd5a-4985-4537-86b3-ff0e4b35873f req-ad7761ef-b219-49af-92c4-52346eb0e443 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:45.787621 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-19d5dd5a-4985-4537-86b3-ff0e4b35873f req-ad7761ef-b219-49af-92c4-52346eb0e443 service nova] Creating event network-vif-deleted:6f17c2c9-ce9d-4f6e-81e8-df6bd994b754 for instance 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac on hv-cinder-81571 Aug 30 01:26:45.793230 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-19d5dd5a-4985-4537-86b3-ff0e4b35873f req-ad7761ef-b219-49af-92c4-52346eb0e443 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035269 Aug 30 01:26:45.793964 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 646/1253] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:26:46.751907 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1d072501-a54a-4625-8797-172fbf5c0fb1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:46.756296 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1d072501-a54a-4625-8797-172fbf5c0fb1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:46.760411 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d072501-a54a-4625-8797-172fbf5c0fb1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:46.760906 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d072501-a54a-4625-8797-172fbf5c0fb1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:46.761384 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d072501-a54a-4625-8797-172fbf5c0fb1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:46.762097 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d072501-a54a-4625-8797-172fbf5c0fb1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:46.762558 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d072501-a54a-4625-8797-172fbf5c0fb1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:46.762991 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d072501-a54a-4625-8797-172fbf5c0fb1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:46.796960 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d072501-a54a-4625-8797-172fbf5c0fb1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:46.796960 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d072501-a54a-4625-8797-172fbf5c0fb1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:46.797239 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d072501-a54a-4625-8797-172fbf5c0fb1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:46.797672 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-1d072501-a54a-4625-8797-172fbf5c0fb1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lazy-loading 'fault' on Instance uuid 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:26:46.842388 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1d072501-a54a-4625-8797-172fbf5c0fb1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:46.850143 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1d072501-a54a-4625-8797-172fbf5c0fb1 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 200 len: 1229 microversion: 2.1 time: 0.103172 Aug 30 01:26:46.850724 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 608/1254] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:46 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 1229 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:47.872574 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-99ba5318-422a-4a27-aa19-06a037c439de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:47.873269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-99ba5318-422a-4a27-aa19-06a037c439de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:47.879796 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-99ba5318-422a-4a27-aa19-06a037c439de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:47.880269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-99ba5318-422a-4a27-aa19-06a037c439de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:47.880699 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-99ba5318-422a-4a27-aa19-06a037c439de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:47.881380 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-99ba5318-422a-4a27-aa19-06a037c439de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:47.881857 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-99ba5318-422a-4a27-aa19-06a037c439de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:47.882275 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-99ba5318-422a-4a27-aa19-06a037c439de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:47.895902 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-99ba5318-422a-4a27-aa19-06a037c439de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] HTTP exception thrown: Instance 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac could not be found. Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-99ba5318-422a-4a27-aa19-06a037c439de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Request method failure captured: Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac HTTP/1.1 Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWWpLAr9Wxt0wzX8nbUp73PagpL6fegcCe0t6pbZeQKLKB3l6OKWJW4BNxRPapRDvkRaK8wMBFjGPNKBt1-gQCF70ZlfsSgzXwofZbj9g7www7kZrpfJXDAcMM3v88TXFyLCWIpba5Ht5dExUdYoBPLVSlZvbG-BSUVeDzCtSM5Kiyg Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 3068817b4ca34beca8bd4da5409e58ef Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-TestVolumeBootPattern-1512577343 Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:26:47.897492 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:26:47.900288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:26:47.900288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-TestVolumeBootPattern-1512577343 Aug 30 01:26:47.900288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 3068817b4ca34beca8bd4da5409e58ef Aug 30 01:26:47.900288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-TestVolumeBootPattern-1512577343 Aug 30 01:26:47.900288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-TestVolumeBootPattern-1512577343-project Aug 30 01:26:47.900288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:26:47.900288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:26:47.900288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: b5b9eb7e61704da582a326e48e3a5170 Aug 30 01:26:47.900288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-TestVolumeBootPattern-1512577343-project Aug 30 01:26:47.900288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:26:47.900288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac could not be found. Aug 30 01:26:47.900288 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': '6c96b9ac-8706-42aa-ba6a-ef444bf4cbac'} Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac could not be found. Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:26:47.901533 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac could not be found. Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac could not be found. Aug 30 01:26:47.903269 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:26:47.904855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-99ba5318-422a-4a27-aa19-06a037c439de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Returning 404 to user: Instance 6c96b9ac-8706-42aa-ba6a-ef444bf4cbac could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:26:47.904855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-99ba5318-422a-4a27-aa19-06a037c439de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac" status: 404 len: 111 microversion: 2.1 time: 0.030640 Aug 30 01:26:47.904855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 647/1255] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:47 2022] GET /compute/v2.1/servers/6c96b9ac-8706-42aa-ba6a-ef444bf4cbac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:26:51.387261 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-92f5b8c1-4f7f-4071-9cd0-f39af1fa2e25 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:51.392225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-92f5b8c1-4f7f-4071-9cd0-f39af1fa2e25 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:51.392380 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [req-99981b06-8118-4696-b0e7-d47da1c973c9 req-f366abed-5972-4283-86f8-4b3ed4f0207f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc20f9c-35e3-4586-a419-82ed45c19481", "tag": "decc0218-8c0d-4f69-a8f7-06f0367b750c"}]} {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:26:51.397427 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92f5b8c1-4f7f-4071-9cd0-f39af1fa2e25 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:51.399048 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92f5b8c1-4f7f-4071-9cd0-f39af1fa2e25 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:51.399772 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92f5b8c1-4f7f-4071-9cd0-f39af1fa2e25 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:51.401573 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92f5b8c1-4f7f-4071-9cd0-f39af1fa2e25 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:51.402465 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92f5b8c1-4f7f-4071-9cd0-f39af1fa2e25 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:51.403206 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92f5b8c1-4f7f-4071-9cd0-f39af1fa2e25 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:51.403441 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-99981b06-8118-4696-b0e7-d47da1c973c9 req-f366abed-5972-4283-86f8-4b3ed4f0207f service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:51.404016 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-99981b06-8118-4696-b0e7-d47da1c973c9 req-f366abed-5972-4283-86f8-4b3ed4f0207f service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:51.404764 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [req-99981b06-8118-4696-b0e7-d47da1c973c9 req-f366abed-5972-4283-86f8-4b3ed4f0207f service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:51.421332 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.compute.server_external_events [req-99981b06-8118-4696-b0e7-d47da1c973c9 req-f366abed-5972-4283-86f8-4b3ed4f0207f service nova] Creating event network-changed:decc0218-8c0d-4f69-a8f7-06f0367b750c for instance 7cc20f9c-35e3-4586-a419-82ed45c19481 on hv-cinder-81571 Aug 30 01:26:51.426988 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [req-99981b06-8118-4696-b0e7-d47da1c973c9 req-f366abed-5972-4283-86f8-4b3ed4f0207f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042037 Aug 30 01:26:51.427915 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 648/1256] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:26:51.437124 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-92f5b8c1-4f7f-4071-9cd0-f39af1fa2e25 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:26:51.772820 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-92f5b8c1-4f7f-4071-9cd0-f39af1fa2e25 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 204 len: 0 microversion: 2.1 time: 0.390782 Aug 30 01:26:51.774047 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 609/1257] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:26:51 2022] DELETE /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:26:51.783649 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-125984fe-6fcf-4392-8692-6507f3b1738d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:51.784373 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-125984fe-6fcf-4392-8692-6507f3b1738d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:51.791194 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-125984fe-6fcf-4392-8692-6507f3b1738d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:51.791827 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-125984fe-6fcf-4392-8692-6507f3b1738d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:51.792305 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-125984fe-6fcf-4392-8692-6507f3b1738d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:51.793125 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-125984fe-6fcf-4392-8692-6507f3b1738d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:51.793607 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-125984fe-6fcf-4392-8692-6507f3b1738d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:51.794078 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-125984fe-6fcf-4392-8692-6507f3b1738d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:51.935409 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-125984fe-6fcf-4392-8692-6507f3b1738d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:51.943661 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-125984fe-6fcf-4392-8692-6507f3b1738d tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1577 microversion: 2.1 time: 0.164607 Aug 30 01:26:51.944274 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 649/1258] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:51 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:52.967818 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e9a8114a-e42f-475f-86d6-5f937d80b57b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:52.968530 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e9a8114a-e42f-475f-86d6-5f937d80b57b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:52.975299 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9a8114a-e42f-475f-86d6-5f937d80b57b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:52.975784 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9a8114a-e42f-475f-86d6-5f937d80b57b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:52.976225 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9a8114a-e42f-475f-86d6-5f937d80b57b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:52.976959 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9a8114a-e42f-475f-86d6-5f937d80b57b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:52.977417 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9a8114a-e42f-475f-86d6-5f937d80b57b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:52.977890 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9a8114a-e42f-475f-86d6-5f937d80b57b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:53.165102 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e9a8114a-e42f-475f-86d6-5f937d80b57b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:53.173918 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e9a8114a-e42f-475f-86d6-5f937d80b57b tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1577 microversion: 2.1 time: 0.211099 Aug 30 01:26:53.174441 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 610/1259] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:52 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1577 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:54.195213 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-4f871e8e-114f-40d9-a9e8-b17363e201de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:54.195818 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-4f871e8e-114f-40d9-a9e8-b17363e201de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:54.202640 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f871e8e-114f-40d9-a9e8-b17363e201de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:54.203117 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f871e8e-114f-40d9-a9e8-b17363e201de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:54.203561 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f871e8e-114f-40d9-a9e8-b17363e201de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:54.204271 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f871e8e-114f-40d9-a9e8-b17363e201de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:54.204736 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f871e8e-114f-40d9-a9e8-b17363e201de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:54.205173 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-4f871e8e-114f-40d9-a9e8-b17363e201de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:54.352719 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-4f871e8e-114f-40d9-a9e8-b17363e201de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:54.360010 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-4f871e8e-114f-40d9-a9e8-b17363e201de tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1459 microversion: 2.1 time: 0.168766 Aug 30 01:26:54.360591 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 650/1260] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:54 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1459 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:26:54.377539 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-224d3c28-df17-48d7-b5dd-489c7cb8cdcf req-da14ae2c-ae42-4c3f-9a7d-46500602ef69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc20f9c-35e3-4586-a419-82ed45c19481", "name": "network-vif-deleted", "tag": "decc0218-8c0d-4f69-a8f7-06f0367b750c"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:26:54.388579 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-224d3c28-df17-48d7-b5dd-489c7cb8cdcf req-da14ae2c-ae42-4c3f-9a7d-46500602ef69 service nova] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:54.389055 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-224d3c28-df17-48d7-b5dd-489c7cb8cdcf req-da14ae2c-ae42-4c3f-9a7d-46500602ef69 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:54.389492 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-224d3c28-df17-48d7-b5dd-489c7cb8cdcf req-da14ae2c-ae42-4c3f-9a7d-46500602ef69 service nova] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:54.402200 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-224d3c28-df17-48d7-b5dd-489c7cb8cdcf req-da14ae2c-ae42-4c3f-9a7d-46500602ef69 service nova] Creating event network-vif-deleted:decc0218-8c0d-4f69-a8f7-06f0367b750c for instance 7cc20f9c-35e3-4586-a419-82ed45c19481 on hv-cinder-81571 Aug 30 01:26:54.407311 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-224d3c28-df17-48d7-b5dd-489c7cb8cdcf req-da14ae2c-ae42-4c3f-9a7d-46500602ef69 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033801 Aug 30 01:26:54.408094 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 611/1261] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 30 01:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:26:55.381126 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-7afcb641-bd65-4d35-be54-602a3f15244f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:55.381785 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-7afcb641-bd65-4d35-be54-602a3f15244f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:55.390400 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7afcb641-bd65-4d35-be54-602a3f15244f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:55.391014 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7afcb641-bd65-4d35-be54-602a3f15244f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:55.391456 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7afcb641-bd65-4d35-be54-602a3f15244f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:55.392199 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7afcb641-bd65-4d35-be54-602a3f15244f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:55.392639 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7afcb641-bd65-4d35-be54-602a3f15244f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:55.393166 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7afcb641-bd65-4d35-be54-602a3f15244f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:55.427478 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7afcb641-bd65-4d35-be54-602a3f15244f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:55.427967 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7afcb641-bd65-4d35-be54-602a3f15244f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:55.428409 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-7afcb641-bd65-4d35-be54-602a3f15244f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:55.428855 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.objects.instance [None req-7afcb641-bd65-4d35-be54-602a3f15244f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lazy-loading 'fault' on Instance uuid 7cc20f9c-35e3-4586-a419-82ed45c19481 {{(pid=121233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:26:55.469498 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.policy [None req-7afcb641-bd65-4d35-be54-602a3f15244f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b9eb7e61704da582a326e48e3a5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3068817b4ca34beca8bd4da5409e58ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:26:55.477342 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-7afcb641-bd65-4d35-be54-602a3f15244f tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 200 len: 1230 microversion: 2.1 time: 0.100557 Aug 30 01:26:55.477932 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 651/1262] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:55 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:26:56.499555 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8d91a537-7b51-4d9d-abe6-5277dcca6b99 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:56.500258 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8d91a537-7b51-4d9d-abe6-5277dcca6b99 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: 7cc20f9c-35e3-4586-a419-82ed45c19481] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:56.506524 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d91a537-7b51-4d9d-abe6-5277dcca6b99 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:56.507009 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d91a537-7b51-4d9d-abe6-5277dcca6b99 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:56.507449 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d91a537-7b51-4d9d-abe6-5277dcca6b99 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:56.508143 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d91a537-7b51-4d9d-abe6-5277dcca6b99 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:56.508598 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d91a537-7b51-4d9d-abe6-5277dcca6b99 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:56.509019 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8d91a537-7b51-4d9d-abe6-5277dcca6b99 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:56.523274 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-8d91a537-7b51-4d9d-abe6-5277dcca6b99 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] HTTP exception thrown: Instance 7cc20f9c-35e3-4586-a419-82ed45c19481 could not be found. Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8d91a537-7b51-4d9d-abe6-5277dcca6b99 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Request method failure captured: Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 HTTP/1.1 Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWWpLAr9Wxt0wzX8nbUp73PagpL6fegcCe0t6pbZeQKLKB3l6OKWJW4BNxRPapRDvkRaK8wMBFjGPNKBt1-gQCF70ZlfsSgzXwofZbj9g7www7kZrpfJXDAcMM3v88TXFyLCWIpba5Ht5dExUdYoBPLVSlZvbG-BSUVeDzCtSM5Kiyg Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 3068817b4ca34beca8bd4da5409e58ef Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-TestVolumeBootPattern-1512577343 Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:26:56.525201 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:26:56.527129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:26:56.527129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-TestVolumeBootPattern-1512577343 Aug 30 01:26:56.527129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 3068817b4ca34beca8bd4da5409e58ef Aug 30 01:26:56.527129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-TestVolumeBootPattern-1512577343 Aug 30 01:26:56.527129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-TestVolumeBootPattern-1512577343-project Aug 30 01:26:56.527129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:26:56.527129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:26:56.527129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: b5b9eb7e61704da582a326e48e3a5170 Aug 30 01:26:56.527129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-TestVolumeBootPattern-1512577343-project Aug 30 01:26:56.527129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:26:56.527129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance 7cc20f9c-35e3-4586-a419-82ed45c19481 could not be found. Aug 30 01:26:56.527129 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': '7cc20f9c-35e3-4586-a419-82ed45c19481'} Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc20f9c-35e3-4586-a419-82ed45c19481 could not be found. Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:26:56.528022 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc20f9c-35e3-4586-a419-82ed45c19481 could not be found. Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc20f9c-35e3-4586-a419-82ed45c19481 could not be found. Aug 30 01:26:56.529386 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:26:56.530649 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8d91a537-7b51-4d9d-abe6-5277dcca6b99 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Returning 404 to user: Instance 7cc20f9c-35e3-4586-a419-82ed45c19481 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:26:56.530649 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8d91a537-7b51-4d9d-abe6-5277dcca6b99 tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481" status: 404 len: 111 microversion: 2.1 time: 0.031816 Aug 30 01:26:56.530649 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 612/1263] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:56 2022] GET /compute/v2.1/servers/7cc20f9c-35e3-4586-a419-82ed45c19481 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:26:57.030726 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-05373b8e-bfbe-436e-9c9c-907f96af7b3a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:57.031333 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.compute.api [None req-05373b8e-bfbe-436e-9c9c-907f96af7b3a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121233) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:57.038099 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-05373b8e-bfbe-436e-9c9c-907f96af7b3a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:57.038582 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-05373b8e-bfbe-436e-9c9c-907f96af7b3a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:57.039020 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-05373b8e-bfbe-436e-9c9c-907f96af7b3a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:57.039706 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-05373b8e-bfbe-436e-9c9c-907f96af7b3a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:57.040163 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-05373b8e-bfbe-436e-9c9c-907f96af7b3a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:57.041141 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG oslo_concurrency.lockutils [None req-05373b8e-bfbe-436e-9c9c-907f96af7b3a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:57.060116 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.wsgi [None req-05373b8e-bfbe-436e-9c9c-907f96af7b3a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] HTTP exception thrown: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-05373b8e-bfbe-436e-9c9c-907f96af7b3a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Request method failure captured: Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: request: DELETE /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 HTTP/1.1 Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept: application/json Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Accept-Encoding: identity Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Connection: close Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Length: 0 Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Content-Type: application/json Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Host: 10.222.0.52 Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: Openstack-System-Scope: None Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: User-Agent: python-urllib3/1.26.12 Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Auth-Token: gAAAAABjDWWpLAr9Wxt0wzX8nbUp73PagpL6fegcCe0t6pbZeQKLKB3l6OKWJW4BNxRPapRDvkRaK8wMBFjGPNKBt1-gQCF70ZlfsSgzXwofZbj9g7www7kZrpfJXDAcMM3v88TXFyLCWIpba5Ht5dExUdYoBPLVSlZvbG-BSUVeDzCtSM5Kiyg Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Id: None Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Domain-Name: None Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Identity-Status: Confirmed Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Is-Admin-Project: True Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Id: default Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Domain-Name: Default Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Id: 3068817b4ca34beca8bd4da5409e58ef Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Project-Name: tempest-TestVolumeBootPattern-1512577343 Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Role: reader,member Aug 30 01:26:57.061795 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Roles: reader,member Aug 30 01:26:57.063609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:26:57.063609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant: tempest-TestVolumeBootPattern-1512577343 Aug 30 01:26:57.063609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Id: 3068817b4ca34beca8bd4da5409e58ef Aug 30 01:26:57.063609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-Tenant-Name: tempest-TestVolumeBootPattern-1512577343 Aug 30 01:26:57.063609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User: tempest-TestVolumeBootPattern-1512577343-project Aug 30 01:26:57.063609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Id: default Aug 30 01:26:57.063609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Domain-Name: Default Aug 30 01:26:57.063609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Id: b5b9eb7e61704da582a326e48e3a5170 Aug 30 01:26:57.063609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: X-User-Name: tempest-TestVolumeBootPattern-1512577343-project Aug 30 01:26:57.063609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: method: > Aug 30 01:26:57.063609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: exception: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. Aug 30 01:26:57.063609 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: action_args: {'id': 'cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9'} Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:26:57.064939 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. Aug 30 01:26:57.066809 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: ERROR nova.api.openstack.wsgi Aug 30 01:26:57.068480 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-05373b8e-bfbe-436e-9c9c-907f96af7b3a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Returning 404 to user: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. {{(pid=121233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:26:57.068480 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-05373b8e-bfbe-436e-9c9c-907f96af7b3a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 404 len: 111 microversion: 2.1 time: 0.036464 Aug 30 01:26:57.068480 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 652/1264] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 30 01:26:57 2022] DELETE /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:26:57.071712 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2ec3c0aa-4b0d-4e76-ae20-8eb58075554e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:57.072344 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2ec3c0aa-4b0d-4e76-ae20-8eb58075554e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] [instance: cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:26:57.078411 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ec3c0aa-4b0d-4e76-ae20-8eb58075554e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:57.078886 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ec3c0aa-4b0d-4e76-ae20-8eb58075554e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:57.079315 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ec3c0aa-4b0d-4e76-ae20-8eb58075554e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:57.079997 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ec3c0aa-4b0d-4e76-ae20-8eb58075554e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Acquiring lock "d4036817-1eea-418e-8a05-ed30a823773a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:26:57.080447 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ec3c0aa-4b0d-4e76-ae20-8eb58075554e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:26:57.080866 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ec3c0aa-4b0d-4e76-ae20-8eb58075554e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Lock "d4036817-1eea-418e-8a05-ed30a823773a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:26:57.095024 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-2ec3c0aa-4b0d-4e76-ae20-8eb58075554e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] HTTP exception thrown: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2ec3c0aa-4b0d-4e76-ae20-8eb58075554e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Request method failure captured: Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 HTTP/1.1 Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Connection: close Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Host: 10.222.0.52 Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.12 Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABjDWWpLAr9Wxt0wzX8nbUp73PagpL6fegcCe0t6pbZeQKLKB3l6OKWJW4BNxRPapRDvkRaK8wMBFjGPNKBt1-gQCF70ZlfsSgzXwofZbj9g7www7kZrpfJXDAcMM3v88TXFyLCWIpba5Ht5dExUdYoBPLVSlZvbG-BSUVeDzCtSM5Kiyg Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Id: 3068817b4ca34beca8bd4da5409e58ef Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-TestVolumeBootPattern-1512577343 Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 30 01:26:57.096541 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 30 01:26:57.098419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3068817b4ca34beca8bd4da5409e58ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 30 01:26:57.098419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-TestVolumeBootPattern-1512577343 Aug 30 01:26:57.098419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 3068817b4ca34beca8bd4da5409e58ef Aug 30 01:26:57.098419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-TestVolumeBootPattern-1512577343 Aug 30 01:26:57.098419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User: tempest-TestVolumeBootPattern-1512577343-project Aug 30 01:26:57.098419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 30 01:26:57.098419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 30 01:26:57.098419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Id: b5b9eb7e61704da582a326e48e3a5170 Aug 30 01:26:57.098419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-TestVolumeBootPattern-1512577343-project Aug 30 01:26:57.098419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: method: > Aug 30 01:26:57.098419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: exception: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. Aug 30 01:26:57.098419 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: action_args: {'id': 'cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9'} Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:26:57.099589 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. Aug 30 01:26:57.101207 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 30 01:26:57.102792 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2ec3c0aa-4b0d-4e76-ae20-8eb58075554e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Returning 404 to user: Instance cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:26:57.102792 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2ec3c0aa-4b0d-4e76-ae20-8eb58075554e tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9" status: 404 len: 111 microversion: 2.1 time: 0.029969 Aug 30 01:26:57.102792 dv-cinder-815712-11-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 613/1265] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 30 01:26:57 2022] GET /compute/v2.1/servers/cb8e9ab2-8a55-4cd3-99d4-abf21200d2a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:26:58.835768 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: DEBUG nova.api.openstack.wsgi [None req-c62984e2-577d-42f1-b361-eaa6e8faf07a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] Calling method '.version_select at 0x7fd71d1c5c10>' {{(pid=121233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:26:58.917576 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: INFO nova.api.openstack.requestlog [None req-c62984e2-577d-42f1-b361-eaa6e8faf07a tempest-TestVolumeBootPattern-1512577343 tempest-TestVolumeBootPattern-1512577343-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-399237452" status: 202 len: 0 microversion: 2.1 time: 0.085647 Aug 30 01:26:58.918230 dv-cinder-815712-11-iscsi devstack@n-api.service[121233]: [pid: 121233|app: 0|req: 653/1266] 10.222.0.52 () {58 vars in 1260 bytes} [Tue Aug 30 01:26:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-399237452 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)